00000001:02000400:1.0F:1789061312.980151:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_hostid 00000001:02000400:1.0:1789061332.503175:0:3187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789061333.882227:0:3230:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 575 MB/s 00000001:01000000:3.0F:1789061334.131960:0:3230:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 703 MB/s 00000001:01000000:0.0F:1789061334.381544:0:3230:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4867 MB/s 00000020:02000000:1.0:1789061335.054879:0:3278:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_ga794951 00000400:02000000:0.0:1789061336.011182:0:3294:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.154@tcp [8/256/0/180] 00008000:02000000:0.0:1789061339.768586:0:3443:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789061394.897760:0:5251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789061405.480045:0:5831:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789061405.480053:0:5831:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789061405.480211:0:5831:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000b4d09591 00000080:02000400:2.0:1789061405.480629:0:5831:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789061405.486165:0:5831:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789061405.486186:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789061405.486378:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000006ac4aed6) 00000020:00000080:2.0:1789061405.486405:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789061405.503835:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789061405.504339:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789061405.529098:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789061405.529150:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789061405.529171:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789061405.529219:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789061405.529331:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789061405.530041:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789061405.530052:0:5831:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789061405.530065:0:5831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9a405 00000020:01000004:2.0:1789061405.530075:0:5831:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789061405.530082:0:5831:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789061405.530087:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b4d09591 from MGS 00000020:01000004:2.0:1789061405.530094:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789061405.530106:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e190cea1) 00000020:00000080:2.0:1789061405.530121:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789061405.530304:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b4d09591 from MGS, refs=2 00080000:01000000:2.0:1789061405.530312:0:5831:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789061405.530330:0:5831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9a413 00000100:00100000:2.0:1789061405.530458:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789061405.530743:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789061405.530818:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789061405.531720:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789061405.531729:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789061405.533077:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061405.533389:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789061405.533397:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789061405.535269:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789061405.535282:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789061405.535926:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789061405.535936:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789061405.536901:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061405.536906:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061405.536907:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061405.537144:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061405.537146:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061405.537148:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061405.538045:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789061405.542016:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789061405.789933:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2775 MB/s 00000001:01000000:2.0:1789061406.039690:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2475 MB/s 00000001:01000000:2.0:1789061406.290212:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 431 MB/s 00000001:01000000:1.0:1789061406.542822:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 525 MB/s 00080000:10000000:1.0:1789061406.556868:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1789061406.576677:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789061406.576703:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789061406.576706:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789061406.578057:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789061406.578270:0:5831:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789061406.578336:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789061406.578974:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789061406.579018:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789061406.582233:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789061406.583192:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789061406.583205:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789061406.584911:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789061406.584924:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789061406.585892:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789061406.585902:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789061406.589286:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789061406.589323:0:5831:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.154@tcp' 00000020:01000004:3.0:1789061406.589326:0:5831:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789061406.589405:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.154@tcp (typ=mgc) 00000100:00080000:0.0:1789061406.590250:0:5846:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1789061406.595732:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.154@tcp (0000000016ff50f7) 00000020:00000080:3.0:1789061406.595772:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789061406.595989:0:5831:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009949e1aa@MGC192.168.204.154@tcp: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1789061406.597291:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.154@tcp-0 is initialized 00000040:01000000:3.0:1789061406.597304:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 1 is initialized 00010000:00010000:2.0:1789061406.598989:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789061406.603839:0:5848:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789061406.603903:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.154@tcp (uuid 24dfd7ac-7455-4043-9449-a564380782df) 00000020:00000080:3.0:1789061406.603934:0:5831:0:(genops.c:1384:class_connect()) connect: client 24dfd7ac-7455-4043-9449-a564380782df, cookie 0x427fa11dc4a9a421 00000100:00080000:3.0:1789061406.603950:0:5831:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789061406.603964:0:5831:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import 000000009949e1aa using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789061406.604029:0:5831:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d8f42cf4 x1875966779457664/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789061406.604070:0:5831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 24dfd7ac-7455-4043-9449-a564380782df->MGS 00000020:01000004:3.0:1789061406.604244:0:5831:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789061406.604253:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789061406.604271:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b76bc177) 00000020:00000080:3.0:1789061406.604286:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789061406.612145:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8f42cf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:24dfd7ac-7455-4043-9449-a564380782df:3309:1875966779457664:0@lo:250: 00000100:00100000:0.0:1789061406.612278:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061406.612565:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779457664 00000100:00100000:1.0:1789061406.612576:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779457664 00000100:00100000:1.0:1789061406.612685:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061406.612692:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004437cd18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1875966779457664:12345-0@lo:250: 00010000:00080000:1.0:1789061406.612862:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 24dfd7ac-7455-4043-9449-a564380782df@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:1.0:1789061406.612912:0:5843:0:(genops.c:1384:class_connect()) connect: client 24dfd7ac-7455-4043-9449-a564380782df, cookie 0x427fa11dc4a9a42f 00000100:00080000:1.0:1789061406.614222:0:5843:0:(import.c:65:import_set_state_nolock()) 00000000ae0d052f : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061406.616210:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004437cd18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+5:3309:x1875966779457664:12345-0@lo:250: Request processed in 3508us (3924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061406.616231:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061406.616364:0:3309:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789061406.616377:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.154@tcp: connect to target with instance 0 00000100:00080000:1.0:1789061406.616387:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789061406.616393:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789061406.616398:0:3309:0:(import.c:65:import_set_state_nolock()) 000000009949e1aa MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789061406.616401:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789061406.616405:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789061406.616425:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8f42cf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:24dfd7ac-7455-4043-9449-a564380782df:3309:1875966779457664:0@lo:250: 00000100:00100000:0.0:1789061406.631809:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789061406.632074:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789061406.632083:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789061406.641664:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789061406.641697:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789061406.642947:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789061406.642961:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789061406.645386:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789061406.646393:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789061406.646403:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789061406.648637:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789061406.648655:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789061406.717021:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061406.717716:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789061406.717727:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789061406.723244:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789061406.723267:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789061406.724402:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061406.724947:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789061406.724955:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789061406.725954:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789061406.725963:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789061406.727251:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061406.728422:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789061406.728434:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789061406.729375:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789061406.729386:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789061406.730282:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061406.730770:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789061406.730778:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789061406.731482:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789061406.731724:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789061406.761780:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789061406.762180:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789061406.762189:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789061406.764171:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789061406.764187:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789061406.766371:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789061406.766401:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789061406.767951:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789061406.767987:0:5831:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789061406.767995:0:5831:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789061406.768253:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789061406.768297:0:5831:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789061406.768303:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789061406.768305:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789061406.768306:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061406.768307:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061406.768308:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061406.768309:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061406.768311:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789061406.768313:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789061406.768314:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789061406.768316:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789061406.768318:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061406.768320:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789061406.768326:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789061406.768328:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789061406.768329:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789061406.768330:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061406.768331:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061406.768332:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061406.768332:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061406.768333:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789061406.768334:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789061406.768335:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789061406.768336:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789061406.768337:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061406.768337:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789061406.768384:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789061406.768418:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000038b61b41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779457792:0@lo:253: 00000100:00100000:0.0:1789061406.768795:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061406.768876:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee47a444 going to sleep for 11 seconds 00000100:00100000:1.0:1789061406.769068:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779457792 00000100:00100000:1.0:1789061406.769087:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779457792 00000100:00100000:1.0:1789061406.769148:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789061406.769158:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d78f055d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+5:5831:x1875966779457792:12345-0@lo:253: 20000000:01000000:1.0:1789061406.769219:0:5845:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789061406.769222:0:5845:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789061406.770109:0:5867:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789061406.770191:0:5845:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789061406.770805:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061406.772311:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789061406.773375:0:5845:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789061406.773382:0:5845:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789061406.773390:0:5845:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789061406.773393:0:5845:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789061406.773430:0:5845:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789061406.774194:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061406.775190:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789061406.775214:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789061406.775357:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789061406.775430:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789061406.775711:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789061406.776073:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789061406.776085:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789061406.776140:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789061406.776149:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789061406.776182:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789061406.776211:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789061406.776322:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789061406.776375:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789061406.776709:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789061406.776717:0:5845:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789061406.776806:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061406.777168:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789061406.777184:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789061406.777224:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789061406.777336:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789061406.777379:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789061406.777392:0:5845:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789061406.777815:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789061406.777827:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789061406.777900:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789061406.778073:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789061406.778104:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789061406.778117:0:5845:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789061406.778206:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789061406.778214:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789061406.778312:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789061406.778345:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789061406.779039:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789061406.779115:0:5845:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789061406.779125:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789061406.780175:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789061406.781282:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789061406.781321:0:5845:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.154@tcp for mdt 20000000:01000000:1.0:1789061406.781324:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:1.0:1789061406.781362:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789061406.781370:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789061406.781395:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789061406.781402:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:1.0:1789061406.781457:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789061406.781469:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789061406.781767:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789061406.781809:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789061406.781979:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789061406.781983:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789061406.781988:0:5845:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789061406.782004:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789061406.782007:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789061406.782162:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789061406.782166:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789061406.782805:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1789061406.783780:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789061406.784192:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1789061406.784305:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1789061406.784324:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789061406.784328:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789061406.785343:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789061406.785744:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789061406.785793:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789061406.785858:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1789061406.785874:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789061406.785876:0:5845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789061406.785882:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789061406.785885:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789061406.785891:0:5845:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789061406.785899:0:5845:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789061406.786904:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789061406.787208:0:5845:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789061406.798252:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789061406.798311:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789061406.798418:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789061406.798446:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789061406.798475:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003e9ca7f0/0x427fa11dc4a9a436 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061406.798524:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e9ca7f0/0x427fa11dc4a9a436 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061406.798537:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003e9ca7f0/0x427fa11dc4a9a436 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061406.798543:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003e9ca7f0/0x427fa11dc4a9a436 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061406.798551:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003e9ca7f0/0x427fa11dc4a9a436 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061406.799172:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003e9ca7f0/0x427fa11dc4a9a436 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061406.799180:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003e9ca7f0 already unused, calling callback (00000000c998ac19) 00010000:00010000:1.0:1789061406.799205:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003e9ca7f0/0x427fa11dc4a9a436 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061406.799214:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003e9ca7f0/0x427fa11dc4a9a436 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061406.799229:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003e9ca7f0/0x427fa11dc4a9a436 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061406.799238:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003e9ca7f0/0x427fa11dc4a9a436 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061406.799244:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e9ca7f0/0x427fa11dc4a9a436 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789061406.799271:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789061407.140574:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d78f055d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+5:5831:x1875966779457792:12345-0@lo:253: Request processed in 371404us (371766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061407.140601:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789061407.140826:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000038b61b41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779457792:0@lo:253: 10000000:01000000:1.0:1789061407.140844:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789061407.140848:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789061407.140851:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789061407.140853:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061407.140855:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789061407.140857:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061407.140858:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061407.140859:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789061407.140861:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789061407.140863:0:5831:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789061407.140865:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061407.140867:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789061407.140889:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b4d09591 from lustre-MDT0000 10000000:01000000:1.0:1789061407.140950:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789061407.140953:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789061407.140958:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff971a47d64d40 10000000:01000000:1.0:1789061407.140963:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789061407.140978:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff971a47d64d40 from 1 10000000:01000000:1.0:1789061407.140982:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789061407.141038:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000003e9ca7f0/0x427fa11dc4a9a43d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061407.141051:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000003e9ca7f0/0x427fa11dc4a9a43d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061407.141060:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000003e9ca7f0/0x427fa11dc4a9a43d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061407.141081:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075970078 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779457920:0@lo:101: 00000100:00100000:1.0:1789061407.141126:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061407.141217:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041add3bf going to sleep for 11 seconds 00000100:00100000:0.0:1789061407.141459:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779457920 00000100:00100000:0.0:1789061407.141469:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779457920 00000100:00100000:0.0:1789061407.141615:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789061407.141625:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001611203a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+5:5831:x1875966779457920:12345-0@lo:101: 00010000:00010000:0.0:1789061407.141642:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061407.141659:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b8bc82da/0x427fa11dc4a9a444 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a43d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.141686:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b8bc82da/0x427fa11dc4a9a444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a43d expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.141697:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b8bc82da/0x427fa11dc4a9a444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a43d expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.141707:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b8bc82da, rc 0) 00000100:00100000:0.0:1789061407.141757:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001611203a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+6:5831:x1875966779457920:12345-0@lo:101: Request processed in 133us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061407.141763:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789061407.141833:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075970078 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779457920:0@lo:101: 00010000:00010000:1.0:1789061407.141846:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000003e9ca7f0/0x427fa11dc4a9a43d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a444 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061407.141855:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000003e9ca7f0/0x427fa11dc4a9a43d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a444 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061407.141906:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075970078 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779458048:0@lo:501: 00000100:00100000:1.0:1789061407.141931:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061407.142186:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041add3bf going to sleep for 11 seconds 00000100:00100000:2.0:1789061407.142221:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779458048 00000100:00100000:2.0:1789061407.142226:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779458048 00000100:00100000:2.0:1789061407.142261:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789061407.142265:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000189d3f51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+6:5831:x1875966779458048:12345-0@lo:501: 00000100:00100000:2.0:1789061407.142708:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000189d3f51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+6:5831:x1875966779458048:12345-0@lo:501: Request processed in 440us (774us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789061407.142773:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789061407.142970:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075970078 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779458048:0@lo:501: 10000000:01000000:1.0:1789061407.143011:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789061407.143081:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000003e9ca7f0/0x427fa11dc4a9a43d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a444 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061407.143103:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000003e9ca7f0/0x427fa11dc4a9a43d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a444 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061407.143114:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff971a46ca8000 10000000:01000000:1.0:1789061407.143119:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789061407.143123:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff971a46ca8000 10000000:01000000:1.0:1789061407.143126:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789061407.143129:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff971a46ca8000 from 1 10000000:01000000:1.0:1789061407.143132:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789061407.143161:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000e3d10f55/0x427fa11dc4a9a44b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061407.143167:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000e3d10f55/0x427fa11dc4a9a44b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061407.143176:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000e3d10f55/0x427fa11dc4a9a44b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061407.143191:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075970078 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779458176:0@lo:101: 00000100:00100000:1.0:1789061407.143229:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061407.143263:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041add3bf going to sleep for 11 seconds 00000100:00100000:2.0:1789061407.143322:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779458176 00000100:00100000:2.0:1789061407.143327:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779458176 00000100:00100000:2.0:1789061407.143364:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789061407.143370:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c9d75cea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+6:5831:x1875966779458176:12345-0@lo:101: 00010000:00010000:2.0:1789061407.143381:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061407.143395:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad8974ef/0x427fa11dc4a9a452 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a44b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061407.143425:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad8974ef/0x427fa11dc4a9a452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a44b expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061407.143434:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad8974ef/0x427fa11dc4a9a452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a44b expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061407.143441:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad8974ef, rc 0) 00000100:00100000:2.0:1789061407.143478:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c9d75cea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+7:5831:x1875966779458176:12345-0@lo:101: Request processed in 109us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061407.143484:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789061407.143580:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075970078 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779458176:0@lo:101: 00010000:00010000:1.0:1789061407.143591:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000e3d10f55/0x427fa11dc4a9a44b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061407.143599:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000e3d10f55/0x427fa11dc4a9a44b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061407.143623:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789061407.143884:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000e3d10f55/0x427fa11dc4a9a44b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061407.143892:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000e3d10f55/0x427fa11dc4a9a44b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061407.143899:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789061407.143904:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789061407.143909:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff971a46ca8000 10000000:01000000:1.0:1789061407.143912:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789061407.143915:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789061407.143917:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789061407.143932:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000006b72821c/0x427fa11dc4a9a459 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061407.143938:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000006b72821c/0x427fa11dc4a9a459 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061407.143946:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000006b72821c/0x427fa11dc4a9a459 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061407.143958:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075970078 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779458304:0@lo:101: 00000100:00100000:1.0:1789061407.143986:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061407.144013:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041add3bf going to sleep for 11 seconds 00000100:00100000:0.0:1789061407.144067:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779458304 00000100:00100000:0.0:1789061407.144073:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779458304 00000100:00100000:0.0:1789061407.144107:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789061407.144113:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a25585a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+7:5831:x1875966779458304:12345-0@lo:101: 00010000:00010000:0.0:1789061407.144122:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061407.144132:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004fd830c6/0x427fa11dc4a9a460 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a459 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.144147:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004fd830c6/0x427fa11dc4a9a460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a459 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.144154:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004fd830c6/0x427fa11dc4a9a460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a459 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.144171:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004fd830c6, rc 0) 00000100:00100000:0.0:1789061407.144211:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a25585a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+8:5831:x1875966779458304:12345-0@lo:101: Request processed in 98us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061407.144217:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789061407.144331:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075970078 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779458304:0@lo:101: 00010000:00010000:1.0:1789061407.144341:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000006b72821c/0x427fa11dc4a9a459 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a460 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061407.144358:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000006b72821c/0x427fa11dc4a9a459 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a460 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061407.144420:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075970078 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779458432:0@lo:501: 00000100:00100000:1.0:1789061407.144445:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061407.144466:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041add3bf going to sleep for 11 seconds 00000100:00100000:0.0:1789061407.144523:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779458432 00000100:00100000:0.0:1789061407.144527:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779458432 00000100:00100000:0.0:1789061407.144557:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789061407.144562:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004bf5abac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+8:5831:x1875966779458432:12345-0@lo:501: 00000100:00100000:0.0:1789061407.144864:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004bf5abac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+9:5831:x1875966779458432:12345-0@lo:501: Request processed in 300us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061407.144872:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789061407.145012:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075970078 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779458432:0@lo:501: 00000100:00100000:2.0:1789061407.145067:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002137718f pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779458560:0@lo:503: 00000100:00100000:2.0:1789061407.145122:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061407.145153:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022c53055 going to sleep for 11 seconds 00000100:00100000:0.0:1789061407.145213:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779458560 00000100:00100000:0.0:1789061407.145218:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779458560 00000100:00100000:0.0:1789061407.145248:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061407.145254:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e6450737 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+9:5831:x1875966779458560:12345-0@lo:503: 00000100:00100000:2.0:1789061407.148921:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002137718f pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779458560:0@lo:503: 00000100:00100000:0.0:1789061407.149230:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e6450737 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+9:5831:x1875966779458560:12345-0@lo:503: Request processed in 3973us (4105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061407.149244:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061407.150965:0:5874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000816d563b pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:5874:1875966779458688:0@lo:502: 00000100:00100000:0.0:1789061407.151069:0:5874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061407.151198:0:5874:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020ecf72b going to sleep for 11 seconds 00000100:00100000:2.0:1789061407.151835:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779458688 00000100:00100000:2.0:1789061407.151845:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779458688 00000100:00100000:2.0:1789061407.151907:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789061407.151917:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f11edd14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+9:5874:x1875966779458688:12345-0@lo:502: 00000100:00100000:2.0:1789061407.152254:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f11edd14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+9:5874:x1875966779458688:12345-0@lo:502: Request processed in 339us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061407.152262:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789061407.154886:0:5874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000816d563b pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:5874:1875966779458688:0@lo:502: 00000020:01000000:1.0:1789061407.154968:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061407.154988:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061407.154991:0:5874:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789061407.154997:0:5874:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789061407.155001:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789061407.155043:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000cc56d7c6) 00000020:00000080:1.0:1789061407.155070:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789061407.155078:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789061407.155185:0:5874:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789061407.155193:0:5874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9a46e 00000020:00000080:1.0:1789061407.155483:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789061407.155514:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061407.155518:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061407.155519:0:5874:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789061407.155522:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061407.155526:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061407.155527:0:5874:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789061407.155530:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789061407.155537:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000071e738d) 00000020:00000080:1.0:1789061407.155548:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789061407.155552:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789061407.155554:0:5874:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789061407.155565:0:5874:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789061407.155573:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789061407.155620:0:5874:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b4d09591 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789061407.155634:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000cf09bdfe) 00000020:00000080:1.0:1789061407.155642:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789061407.155712:0:5874:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789061407.156854:0:5874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x427fa11dc4a9a483 00000020:00000080:1.0:1789061407.157054:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789061407.157065:0:5874:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789061407.157071:0:5874:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x427fa11dc4a9a48a 00080000:01000000:1.0:1789061407.157080:0:5874:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789061407.157084:0:5874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9a491 00080000:10000000:0.0:1789061407.161997:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1789061407.162427:0:5874:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789061407.170666:0:5874:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1789061407.316452:0:5874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1789061407.318747:0:5874:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1789061407.321038:0:5874:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789061407.321432:0:5874:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789061407.443371:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000003244b3f2) 00000020:00000080:1.0:1789061407.443411:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789061407.443539:0:5874:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789061407.443557:0:5874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9a49f 00000020:00000080:1.0:1789061407.443819:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789061407.445296:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789061407.556992:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00010000:00010000:2.0:1789061407.616687:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1789061407.642695:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789061407.735370:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789061407.800585:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789061407.880254:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1789061407.951925:0:5874:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x427fa11dc4a9a4a6 00000020:00000080:3.0:1789061407.952575:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789061407.952590:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061407.952599:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061407.952602:0:5874:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789061407.952605:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061407.952609:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061407.952611:0:5874:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789061407.952614:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789061407.952616:0:5874:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789061407.952619:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061407.952621:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061407.952622:0:5874:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789061407.952625:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061407.952629:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061407.952637:0:5874:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789061407.952643:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789061407.952687:0:5874:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1789061407.952873:0:5874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd362028 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:5874:1875966779458816:0@lo:502: 00000100:00100000:3.0:1789061407.952982:0:5874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061407.953166:0:5874:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fae6007e going to sleep for 11 seconds 00000100:00100000:1.0:1789061407.953298:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779458816 00000100:00100000:1.0:1789061407.953309:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779458816 00000100:00100000:1.0:1789061407.953409:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789061407.953419:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e5488bf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+9:5874:x1875966779458816:12345-0@lo:502: 00000100:00100000:1.0:1789061407.953911:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e5488bf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+9:5874:x1875966779458816:12345-0@lo:502: Request processed in 492us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061407.953920:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789061407.954037:0:5874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd362028 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:5874:1875966779458816:0@lo:502: 00000020:01000000:3.0:1789061407.954077:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061407.954085:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061407.954087:0:5874:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789061407.954091:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789061407.954440:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789061407.954469:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789061407.954513:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000006b72821c/0x427fa11dc4a9a459 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a460 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.954526:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000006b72821c/0x427fa11dc4a9a459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a460 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061407.954535:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff971a46ca8000 from 1 10000000:01000000:0.0:1789061407.954538:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789061407.954578:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.954585:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.954596:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061407.954614:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000522cb9d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779458944:0@lo:101: 00000100:00100000:0.0:1789061407.954662:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061407.954964:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000888affeb going to sleep for 11 seconds 00000100:00100000:2.0:1789061407.955050:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779458944 00000100:00100000:2.0:1789061407.955059:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779458944 00000100:00100000:2.0:1789061407.955096:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789061407.955103:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a34acd17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+9:5831:x1875966779458944:12345-0@lo:101: 00010000:00010000:2.0:1789061407.955116:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061407.955133:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3029d0e/0x427fa11dc4a9a4b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a4ad expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061407.955161:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3029d0e/0x427fa11dc4a9a4b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a4ad expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061407.955172:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3029d0e/0x427fa11dc4a9a4b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a4ad expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061407.955180:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3029d0e, rc 0) 00000100:00100000:2.0:1789061407.955228:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a34acd17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+10:5831:x1875966779458944:12345-0@lo:101: Request processed in 126us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061407.955235:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789061407.955427:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000522cb9d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779458944:0@lo:101: 00010000:00010000:0.0:1789061407.955443:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.955464:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061407.956244:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000522cb9d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459072:0@lo:256: 00000100:00100000:0.0:1789061407.956315:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061407.956339:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000888affeb going to sleep for 11 seconds 00000100:00100000:2.0:1789061407.956456:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779459072 00000100:00100000:2.0:1789061407.956463:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779459072 00000100:00100000:2.0:1789061407.956531:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789061407.956539:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000566934d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+10:5831:x1875966779459072:12345-0@lo:256: 20000000:01000000:2.0:1789061407.956559:0:5845:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789061407.956567:0:5845:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789061407.956642:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000566934d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+10:5831:x1875966779459072:12345-0@lo:256: Request processed in 104us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061407.956649:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789061407.956746:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000522cb9d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459072:0@lo:256: 10000000:01000000:0.0:1789061407.957555:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789061407.957576:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.957587:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061407.957596:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a46ca8000 from 1 10000000:01000000:0.0:1789061407.957599:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789061407.957637:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.957644:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.957653:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061407.957668:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000522cb9d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459200:0@lo:101: 00000100:00100000:0.0:1789061407.957777:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061407.957823:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000888affeb going to sleep for 11 seconds 00000100:00100000:2.0:1789061407.957930:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779459200 00000100:00100000:2.0:1789061407.957937:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779459200 00000100:00100000:2.0:1789061407.957970:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789061407.957975:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000074559028 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+10:5831:x1875966779459200:12345-0@lo:101: 00010000:00010000:2.0:1789061407.957987:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061407.958002:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b896b94/0x427fa11dc4a9a4c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a4bb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061407.958101:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b896b94/0x427fa11dc4a9a4c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a4bb expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061407.958112:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b896b94/0x427fa11dc4a9a4c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a4bb expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061407.958121:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b896b94, rc 0) 00000100:00100000:2.0:1789061407.958166:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000074559028 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+11:5831:x1875966779459200:12345-0@lo:101: Request processed in 191us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061407.958173:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789061407.958345:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000522cb9d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459200:0@lo:101: 00010000:00010000:0.0:1789061407.958358:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.958366:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061407.958444:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000522cb9d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459328:0@lo:501: 00000100:00100000:0.0:1789061407.958472:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061407.958587:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779459328 00000100:00100000:2.0:1789061407.958592:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779459328 00000100:00100000:2.0:1789061407.958628:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789061407.958634:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000839ffb1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+11:5831:x1875966779459328:12345-0@lo:501: 00000100:00100000:1.0:1789061407.959002:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000888affeb going to sleep for 11 seconds 00000100:00100000:3.0:1789061407.960377:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000839ffb1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+11:5831:x1875966779459328:12345-0@lo:501: Request processed in 1738us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061407.960404:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789061407.960838:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000522cb9d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459328:0@lo:501: 00000100:00100000:1.0:1789061407.960907:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035356dec pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459456:0@lo:503: 00000100:00100000:1.0:1789061407.960970:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061407.961036:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082a783c7 going to sleep for 11 seconds 00000100:00100000:0.0:1789061407.961158:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779459456 00000100:00100000:0.0:1789061407.961168:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779459456 00000100:00100000:0.0:1789061407.961224:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789061407.961233:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008150b307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+11:5831:x1875966779459456:12345-0@lo:503: 00000040:00080000:0.0:1789061407.961298:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789061407.961351:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008150b307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+11:5831:x1875966779459456:12345-0@lo:503: Request processed in 120us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061407.961358:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789061407.961466:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035356dec pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459456:0@lo:503: 00000040:00080000:2.0:1789061407.963155:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1789061407.963656:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789061407.963688:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789061407.963800:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.963817:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061407.963876:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789061407.963879:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff971a46ca8000 10000000:01000000:0.0:1789061407.963882:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff971a46ca8000 10000000:01000000:0.0:1789061407.963901:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789061407.963908:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff971a46ca8000 from 1 10000000:01000000:0.0:1789061407.963911:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789061407.963954:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 0000000019ad4c6d/0x427fa11dc4a9a4c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.963962:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 0000000019ad4c6d/0x427fa11dc4a9a4c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061407.963973:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 0000000019ad4c6d/0x427fa11dc4a9a4c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061407.963997:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c81ae7ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459584:0@lo:101: 00000100:00100000:0.0:1789061407.964154:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061407.964202:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7941a1b going to sleep for 11 seconds 00000100:00100000:3.0:1789061407.964265:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779459584 00000100:00100000:3.0:1789061407.964274:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779459584 00000100:00100000:3.0:1789061407.964328:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789061407.964337:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae8720b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+11:5831:x1875966779459584:12345-0@lo:101: 00010000:00010000:3.0:1789061407.964351:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061407.964369:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dde765ee/0x427fa11dc4a9a4d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a4c9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061407.964408:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dde765ee/0x427fa11dc4a9a4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a4c9 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061407.964419:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dde765ee/0x427fa11dc4a9a4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a4c9 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061407.964429:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dde765ee, rc 0) 00000100:00100000:3.0:1789061407.964523:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae8720b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:5831:x1875966779459584:12345-0@lo:101: Request processed in 187us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061407.964530:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789061407.964652:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c81ae7ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459584:0@lo:101: 00010000:00010000:1.0:1789061407.964668:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 0000000019ad4c6d/0x427fa11dc4a9a4c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a4d0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061407.964677:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 0000000019ad4c6d/0x427fa11dc4a9a4c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a4d0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061407.964744:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca3b58d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459712:0@lo:501: 00000100:00100000:1.0:1789061407.964770:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061407.964798:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779459712 00000100:00100000:1.0:1789061407.964803:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779459712 00000100:00100000:1.0:1789061407.964826:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789061407.964832:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000723edd79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:5831:x1875966779459712:12345-0@lo:501: 00000100:00100000:1.0:1789061407.965294:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000723edd79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:5831:x1875966779459712:12345-0@lo:501: Request processed in 461us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061407.965303:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789061407.965343:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000008234774f going to sleep for 11 seconds 00000100:00100000:1.0:1789061407.965358:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca3b58d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459712:0@lo:501: 00000100:00100000:1.0:1789061407.965403:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca3b58d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459840:0@lo:503: 00000100:00100000:1.0:1789061407.965441:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061407.965457:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000008234774f going to sleep for 11 seconds 00000100:00100000:1.0:1789061407.965470:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779459840 00000100:00100000:1.0:1789061407.965474:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779459840 00000100:00100000:1.0:1789061407.965523:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789061407.965529:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac38a8a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:5831:x1875966779459840:12345-0@lo:503: 00000100:00100000:1.0:1789061407.965906:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac38a8a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:5831:x1875966779459840:12345-0@lo:503: Request processed in 378us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061407.965921:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789061407.965975:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca3b58d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779459840:0@lo:503: 00000100:00100000:3.0:1789061407.966658:0:5879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd362028 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:5879:1875966779459968:0@lo:502: 00000100:00100000:3.0:1789061407.966826:0:5879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061407.966863:0:5879:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060158550 going to sleep for 11 seconds 00000100:00100000:1.0:1789061407.966915:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779459968 00000100:00100000:1.0:1789061407.966922:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779459968 00000100:00100000:1.0:1789061407.966962:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789061407.966970:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000044a22543 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:5879:x1875966779459968:12345-0@lo:502: 00000100:00100000:1.0:1789061407.967957:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000044a22543 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:5879:x1875966779459968:12345-0@lo:502: Request processed in 983us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061407.967971:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789061407.968164:0:5879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd362028 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:5879:1875966779459968:0@lo:502: 00000020:01000004:3.0:1789061407.968250:0:5879:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789061407.968273:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000070564a2a) 00000020:00000080:3.0:1789061407.968298:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789061407.968442:0:5879:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b4d09591 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789061407.968448:0:5879:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b4d09591 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789061407.968451:0:5879:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b4d09591 4 00010000:00080000:3.0:1789061407.968679:0:5879:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000db20c69f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1789061407.972323:0:5879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789061407.972688:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789061407.972810:0:5879:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789061407.972826:0:5879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x427fa11dc4a9a4de 00000100:00080000:3.0:1789061407.972839:0:5879:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789061407.972853:0:5879:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000db20c69f using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789061407.972899:0:5879:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cd362028 x1875966779460096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789061407.972930:0:5879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789061407.973205:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd362028 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875966779460096:0@lo:38: 00000100:00100000:1.0:1789061407.973295:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061407.973575:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779460096 00000100:00100000:3.0:1789061407.973585:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779460096 00000100:00100000:3.0:1789061407.973625:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789061407.973631:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ca3b58d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875966779460096:12345-0@lo:38: 00000100:00100000:1.0:1789061407.973815:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789061407.973824:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000db20c69f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789061407.973829:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789061407.973832:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd362028 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875966779460096:0@lo:38: 00000100:00100000:3.0:1789061407.973871:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ca3b58d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875966779460096:12345-0@lo:38: Request processed in 237us (576us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789061407.973885:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789061407.973993:0:5879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d86d2071 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:5879:1875966779460224:0@lo:502: 00000100:00100000:3.0:1789061407.974217:0:5879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061407.974249:0:5879:0:(client.c:2716:ptlrpc_set_wait()) set 000000007845921f going to sleep for 11 seconds 00000100:00100000:1.0:1789061407.974296:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779460224 00000100:00100000:1.0:1789061407.974301:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779460224 00000100:00100000:1.0:1789061407.974345:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789061407.974354:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000018e421bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:5879:x1875966779460224:12345-0@lo:502: 00000100:00100000:1.0:1789061407.974677:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000018e421bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:5879:x1875966779460224:12345-0@lo:502: Request processed in 324us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061407.974684:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789061407.974819:0:5879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d86d2071 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:5879:1875966779460224:0@lo:502: 00000040:00080000:2.0:1789061407.974850:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1789061407.975005:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789061407.975089:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789061407.975207:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 0000000019ad4c6d/0x427fa11dc4a9a4c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a4d0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061407.975228:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 0000000019ad4c6d/0x427fa11dc4a9a4c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a4d0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789061407.975285:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789061407.975287:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789061407.975289:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061407.975290:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789061407.975292:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061407.975293:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061407.975294:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789061407.975296:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789061407.975298:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789061407.975300:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789061407.975302:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061407.975303:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789061407.975309:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789061407.975312:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789061407.975313:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789061407.975314:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061407.975315:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789061407.975316:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061407.975317:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061407.975318:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789061407.975319:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789061407.975319:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789061407.975320:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789061407.975321:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061407.975322:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789061407.975342:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789061407.975354:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018805037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779460352:0@lo:253: 00000100:00100000:1.0:1789061407.975410:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061407.975444:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c54a472f going to sleep for 11 seconds 00000100:00100000:3.0:1789061407.975745:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779460352 00000100:00100000:3.0:1789061407.975753:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779460352 00000100:00100000:3.0:1789061407.975792:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789061407.975799:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a560bdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:5831:x1875966779460352:12345-0@lo:253: 20000000:01000000:3.0:1789061407.975830:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789061407.975849:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789061408.040984:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789061408.041008:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789061408.041090:0:5867:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789061408.041098:0:5867:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789061408.041128:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061408.041154:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a3029d0e/0x427fa11dc4a9a4b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a4ad expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061408.041162:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061408.041220:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a3029d0e/0x427fa11dc4a9a4b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a4ad expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061408.041239:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a3029d0e/0x427fa11dc4a9a4b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4ad expref: 12 pid: 5845 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061408.041256:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002137718f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1875966779460480:0@lo:104: 00000100:00100000:2.0:1789061408.041342:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061408.041943:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efd49df8 going to sleep for 11 seconds 00000100:00100000:3.0:1789061408.042113:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779460480 00000100:00100000:3.0:1789061408.042124:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779460480 00000100:00100000:3.0:1789061408.042219:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789061408.042229:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000618d1477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+3:5867:x1875966779460480:12345-0@lo:104: 00010000:00010000:3.0:1789061408.042246:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061408.042333:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789061408.042339:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000618d1477 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+3:5867:x1875966779460480:12345-0@lo:104: Request processed in 112us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061408.042347:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789061408.042411:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061408.042444:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.042452:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003e143549 already unused, calling callback (000000001bdec245) 10000000:00010000:1.0:1789061408.042456:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.042464:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061408.042470:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061408.042476:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789061408.042536:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.042543:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061408.042563:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.042571:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 000000003e143549/0x427fa11dc4a9a4ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a4b4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.042590:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061408.042592:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061408.042594:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061408.042659:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cdd077fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779460608:0@lo:103: 00000100:00100000:1.0:1789061408.042713:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061408.042804:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779460608 00000100:00100000:2.0:1789061408.042926:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002137718f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1875966779460480:0@lo:104: 00010000:00010000:2.0:1789061408.042949:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061408.043162:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779460608 00010000:00010000:1.0:1789061408.043190:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a3029d0e/0x427fa11dc4a9a4b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4ad expref: 13 pid: 5845 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061408.043226:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061408.043233:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002b5a252d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+13:3311:x1875966779460608:12345-0@lo:103: 00010000:00010000:1.0:1789061408.043245:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061408.043250:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a3029d0e/0x427fa11dc4a9a4b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4ad expref: 13 pid: 5845 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.043261:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a3029d0e/0x427fa11dc4a9a4b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4ad expref: 13 pid: 5845 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.043276:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a3029d0e/0x427fa11dc4a9a4b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a4ad expref: 13 pid: 5845 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.043291:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.043299:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789061408.043313:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002217561s 00010000:00010000:1.0:1789061408.043318:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.043325:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.043333:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.043338:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.043350:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000357004ef already unused, calling callback (00000000c998ac19) 00010000:00010000:1.0:1789061408.043353:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.043360:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.043375:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.043395:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061408.043440:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002b5a252d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+12:3311:x1875966779460608:12345-0@lo:103: Request processed in 208us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061408.043446:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789061408.043464:0:5867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.043470:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061408.043474:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000357004ef/0x427fa11dc4a9a4e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061408.043659:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cdd077fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779460608:0@lo:103: 00000100:00100000:1.0:1789061408.060864:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a560bdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+11:5831:x1875966779460352:12345-0@lo:253: Request processed in 85052us (85441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061408.060883:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789061408.061602:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018805037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:5831:1875966779460352:0@lo:253: 10000000:01000000:2.0:1789061408.061625:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789061408.061628:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789061408.061630:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789061408.061632:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061408.061633:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061408.061634:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061408.061635:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061408.061636:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789061408.061638:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789061408.061640:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789061408.061641:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789061408.061642:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061408.061644:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789061408.061664:0:5831:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789061408.097735:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789061408.110712:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789061408.113230:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789061408.115992:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789061408.117163:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789061408.117978:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789061408.121633:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789061408.123160:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789061408.123565:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789061408.123881:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789061408.124144:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789061408.124333:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1789061408.193630:0:5831:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789061408.331570:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789061408.331660:0:5884:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789061408.331664:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789061408.333949:0:5885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789061408.339027:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789061408.339444:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789061408.340068:0:5831:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789061408.340081:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789061408.340258:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061408.345958:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789061408.346648:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789061408.347136:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789061408.347528:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789061408.348105:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789061408.356466:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789061408.359941:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789061408.360608:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789061408.360856:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789061408.363140:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789061408.363658:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789061408.366465:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789061408.367155:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789061408.367301:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789061408.367525:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789061408.367710:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789061408.367884:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789061408.369570:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789061408.369779:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789061408.369927:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789061408.370113:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789061408.370426:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789061408.370630:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789061408.371202:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789061408.371409:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789061408.372222:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789061408.372427:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789061408.375293:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789061408.375990:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789061408.376217:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789061408.376419:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789061408.376612:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789061408.376980:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789061408.377204:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789061408.377355:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789061408.377921:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789061408.378176:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789061408.379194:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1789061408.447421:0:5885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789061408.503276:0:5831:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789061408.503328:0:5831:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7c9c1c73988 00100000:10000000:3.0:1789061408.503341:0:5831:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789061408.506797:0:5831:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789061408.506823:0:5831:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789061408.506842:0:5831:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789061408.506868:0:5831:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1789061408.626527:0:5885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789061408.627949:0:5885:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789061408.627956:0:5885:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789061408.640009:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061409.664634:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061410.685618:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061411.709591:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061412.735786:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789061413.119245:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789061413.119255:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789061413.119259:0:8:0:(import.c:65:import_set_state_nolock()) 00000000db20c69f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789061413.119553:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000db20c69f using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789061413.119595:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000026bc391c x1875966779460864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789061413.119657:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026bc391c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875966779460864:0@lo:38: 00000100:00100000:1.0:1789061413.119730:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061413.119960:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779460864 00000100:00100000:3.0:1789061413.119968:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779460864 00000100:00100000:3.0:1789061413.120003:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061413.120011:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cdd077fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875966779460864:12345-0@lo:38: 00010000:00080000:3.0:1789061413.120039:0:5853:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:3.0:1789061413.120157:0:5853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x427fa11dc4a9a4ec 00000004:00100000:3.0:1789061413.120204:0:5853:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789061413.120553:0:5853:0:(import.c:65:import_set_state_nolock()) 0000000007fb7af9 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789061413.120681:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000072a42988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779460736:0@lo:400: 00000100:00100000:0.0:1789061413.120721:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061413.120762:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779460736 00000100:00100000:0.0:1789061413.120766:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779460736 00000100:00100000:3.0:1789061413.121397:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cdd077fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875966779460864:12345-0@lo:38: Request processed in 1382us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061413.121406:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789061413.124605:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789061413.124623:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007c71fd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+11:3312:x1875966779460736:12345-0@lo:400: 00000100:00100000:0.0:1789061413.124711:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007c71fd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+11:3312:x1875966779460736:12345-0@lo:400: Request processed in 95us (3990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061413.124716:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789061413.124779:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000072a42988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779460736:0@lo:400: 00010000:00080000:1.0:1789061413.131669:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000026bc391c x1875966779460864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789061423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789061413.131696:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789061413.131706:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789061413.131711:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789061413.131715:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000db20c69f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789061413.131722:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026bc391c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875966779460864:0@lo:38: 00000001:02000400:0.0:1789061413.565825:0:6127:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1789061413.629798:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789061413.629806:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff971a46ca8000 from 3 10000000:01000000:3.0:1789061413.629812:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789061413.629861:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000e8ae9934/0x427fa11dc4a9a4f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061413.629875:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000e8ae9934/0x427fa11dc4a9a4f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061413.629886:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000e8ae9934/0x427fa11dc4a9a4f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061413.629909:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003e953711 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779460992:0@lo:101: 00000100:00100000:3.0:1789061413.629986:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061413.630047:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc9c77dd going to sleep for 11 seconds 00000100:00100000:3.0:1789061413.630126:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779460992 00000100:00100000:3.0:1789061413.630134:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779460992 00000100:00100000:3.0:1789061413.630188:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789061413.630198:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf2f77f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+11:5848:x1875966779460992:12345-0@lo:101: 00010000:00010000:3.0:1789061413.630215:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061413.630229:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000092752ae/0x427fa11dc4a9a4fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a4f3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061413.630253:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000092752ae/0x427fa11dc4a9a4fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a4f3 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061413.630460:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000092752ae/0x427fa11dc4a9a4fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a4f3 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061413.630473:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000092752ae, rc 0) 00000100:00100000:3.0:1789061413.630552:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf2f77f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:5848:x1875966779460992:12345-0@lo:101: Request processed in 355us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061413.630560:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789061413.630695:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003e953711 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779460992:0@lo:101: 00010000:00010000:1.0:1789061413.630712:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000e8ae9934/0x427fa11dc4a9a4f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a4fa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061413.630721:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000e8ae9934/0x427fa11dc4a9a4f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a4fa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061413.630774:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c5d7af5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779461120:0@lo:256: 00000100:00100000:1.0:1789061413.630813:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061413.630847:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ad40ccc going to sleep for 11 seconds 00000100:00100000:3.0:1789061413.631156:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779461120 00000100:00100000:3.0:1789061413.631162:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779461120 00000100:00100000:3.0:1789061413.631192:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789061413.631199:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000872b75bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:5848:x1875966779461120:12345-0@lo:256: 20000000:01000000:3.0:1789061413.631217:0:5843:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789061413.631238:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789061413.631242:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789061413.631521:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000872b75bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:5848:x1875966779461120:12345-0@lo:256: Request processed in 322us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061413.631529:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789061413.631570:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c5d7af5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779461120:0@lo:256: 10000000:01000000:3.0:1789061413.631620:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789061413.631628:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000e8ae9934/0x427fa11dc4a9a4f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a4fa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061413.631637:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000e8ae9934/0x427fa11dc4a9a4f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a4fa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061413.758603:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061414.784661:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061415.807010:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061416.829801:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061417.856845:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061418.242533:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002137718f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779461248:0@lo:400: 00000100:00100000:1.0:1789061418.242639:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061418.242780:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779461248 00000100:00100000:0.0:1789061418.242792:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779461248 00000100:00100000:0.0:1789061418.242855:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789061418.242864:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c78d2dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:3313:x1875966779461248:12345-0@lo:400: 00000100:00100000:2.0:1789061418.242997:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000918eeec1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779461376:0@lo:400: 00000100:00100000:2.0:1789061418.243041:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061418.243091:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779461376 00000100:00100000:2.0:1789061418.243096:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779461376 00000100:00100000:2.0:1789061418.243141:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789061418.243148:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ebd477c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779461376:12345-0@lo:400: 00000100:00100000:2.0:1789061418.243186:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ebd477c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779461376:12345-0@lo:400: Request processed in 39us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061418.243221:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789061418.243275:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000918eeec1 x1875966779461376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061418.243292:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000918eeec1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779461376:0@lo:400: 00000100:00100000:0.0:1789061418.250741:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c78d2dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:3313:x1875966779461248:12345-0@lo:400: Request processed in 7866us (8089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061418.250763:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789061418.255265:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002137718f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779461248:0@lo:400: 00010000:00010000:2.0:1789061418.885009:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789061419.185355:0:6330:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6a851c60 20000000:00000080:1.0:1789061419.185380:0:6330:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff971a75b4e000 uarg=0000000000000000 20000000:01000000:1.0:1789061419.185428:0:6330:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789061419.185437:0:6330:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789061419.185442:0:6330:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789061419.186077:0:6330:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789061419.186092:0:6330:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789061419.192390:0:6330:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061419.192765:0:6330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789061419.192827:0:6330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789061419.192883:0:6330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789061419.192903:0:6330:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789061419.192927:0:6330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061419.192950:0:6330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007b896b94/0x427fa11dc4a9a4c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a4bb expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061419.192959:0:6330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061419.193010:0:6330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007b896b94/0x427fa11dc4a9a4c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a4bb expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061419.193029:0:6330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007b896b94/0x427fa11dc4a9a4c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4bb expref: 11 pid: 5845 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061419.193046:0:6330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f02efcf pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6330:1875966779461504:0@lo:104: 00000100:00100000:0.0:1789061419.193140:0:6330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061419.193215:0:6330:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f041ae5 going to sleep for 11 seconds 00000100:00100000:3.0:1789061419.193312:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779461504 00000100:00100000:3.0:1789061419.193323:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779461504 00000100:00100000:3.0:1789061419.193392:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061419.193402:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001ffb8590 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+3:6330:x1875966779461504:12345-0@lo:104: 00010000:00010000:3.0:1789061419.193416:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061419.193512:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789061419.193519:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001ffb8590 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+3:6330:x1875966779461504:12345-0@lo:104: Request processed in 119us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061419.193526:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789061419.193674:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061419.193681:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061419.193691:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000087562968 already unused, calling callback (000000001bdec245) 10000000:00010000:2.0:1789061419.193694:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061419.193704:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061419.193711:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061419.193717:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789061419.193750:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061419.193757:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061419.193777:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061419.193783:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 0000000087562968/0x427fa11dc4a9a4bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a4c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061419.193817:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061419.193819:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061419.193821:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061419.193834:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000918eeec1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779461632:0@lo:103: 00000100:00100000:2.0:1789061419.193869:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061419.194104:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779461632 00000100:00100000:1.0:1789061419.194110:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779461632 00010000:00010000:1.0:1789061419.194134:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007b896b94/0x427fa11dc4a9a4c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4bb expref: 12 pid: 5845 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061419.194160:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789061419.194166:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ffd2b228 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+12:3311:x1875966779461632:12345-0@lo:103: 00010000:00010000:1.0:1789061419.194191:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061419.194196:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007b896b94/0x427fa11dc4a9a4c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4bb expref: 12 pid: 5845 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061419.195993:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007b896b94/0x427fa11dc4a9a4c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4bb expref: 12 pid: 5845 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061419.196306:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061419.196317:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061419.196342:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061419.196349:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061419.196355:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061419.196361:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061419.196367:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d04c4876 already unused, calling callback (00000000c998ac19) 00010000:00010000:1.0:1789061419.196371:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061419.196380:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061419.196390:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061419.196403:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061419.196707:0:6330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007b896b94/0x427fa11dc4a9a4c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a4bb expref: 12 pid: 5845 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061419.196725:0:6330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f02efcf pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6330:1875966779461504:0@lo:104: 00010000:00010000:0.0:1789061419.196749:0:6330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061419.196758:0:6330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061419.196764:0:6330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061419.196770:0:6330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d04c4876/0x427fa11dc4a9a501 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061419.197881:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ffd2b228 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+11:3311:x1875966779461632:12345-0@lo:103: Request processed in 3709us (4005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061419.197908:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789061419.202421:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000918eeec1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779461632:0@lo:103: 00010000:00010000:2.0:1789061419.905246:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061420.926401:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789061420.989655:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789061420.989668:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a46ca8000 from 1 10000000:01000000:3.0:1789061420.989674:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789061420.989750:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000003a051b79/0x427fa11dc4a9a508 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061420.989777:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000003a051b79/0x427fa11dc4a9a508 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061420.989791:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000003a051b79/0x427fa11dc4a9a508 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061420.989850:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ac50179 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779461760:0@lo:101: 00000100:00100000:3.0:1789061420.989952:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061420.990041:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b61151cb going to sleep for 11 seconds 00000100:00100000:0.0:1789061420.990219:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779461760 00000100:00100000:0.0:1789061420.990229:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779461760 00000100:00100000:0.0:1789061420.990294:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789061420.990303:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf504aed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+11:5848:x1875966779461760:12345-0@lo:101: 00010000:00010000:0.0:1789061420.990320:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061420.990337:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000037af98e/0x427fa11dc4a9a50f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a508 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061420.990365:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000037af98e/0x427fa11dc4a9a50f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a508 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061420.990377:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000037af98e/0x427fa11dc4a9a50f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a508 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061420.990407:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000037af98e, rc 0) 00000100:00100000:0.0:1789061420.990470:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf504aed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:5848:x1875966779461760:12345-0@lo:101: Request processed in 168us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061420.990477:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789061420.991066:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ac50179 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779461760:0@lo:101: 00010000:00010000:3.0:1789061420.991095:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000003a051b79/0x427fa11dc4a9a508 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a50f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061420.991107:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000003a051b79/0x427fa11dc4a9a508 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a50f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061420.991729:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ac50179 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779461888:0@lo:501: 00000100:00100000:3.0:1789061420.993348:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061420.993713:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779461888 00000100:00100000:1.0:1789061420.993726:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779461888 00000100:00100000:1.0:1789061420.993803:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789061420.993813:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005151e95a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:5848:x1875966779461888:12345-0@lo:501: 00000100:00100000:1.0:1789061420.994166:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005151e95a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:5848:x1875966779461888:12345-0@lo:501: Request processed in 355us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061420.994174:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789061420.994574:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b61151cb going to sleep for 11 seconds 00000100:00100000:3.0:1789061420.994601:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ac50179 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779461888:0@lo:501: 00000100:00100000:3.0:1789061420.994663:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ac50179 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779462016:0@lo:503: 00000100:00100000:3.0:1789061420.994716:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061420.994731:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b61151cb going to sleep for 11 seconds 00000100:00100000:0.0:1789061420.996249:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779462016 00000100:00100000:0.0:1789061420.996265:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779462016 00000100:00100000:0.0:1789061420.996327:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789061420.996336:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003987ecd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:5848:x1875966779462016:12345-0@lo:503: 00000100:00100000:0.0:1789061420.996610:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003987ecd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:5848:x1875966779462016:12345-0@lo:503: Request processed in 276us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061420.996618:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789061420.999711:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ac50179 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779462016:0@lo:503: 00000100:00100000:3.0:1789061421.001854:0:6398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ac50179 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:6398:1875966779462144:0@lo:502: 00000100:00100000:3.0:1789061421.001972:0:6398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061421.002034:0:6398:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d957aeb3 going to sleep for 11 seconds 00000100:00100000:0.0:1789061421.002172:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779462144 00000100:00100000:0.0:1789061421.002182:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779462144 00000100:00100000:0.0:1789061421.002249:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789061421.002259:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000095833506 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:6398:x1875966779462144:12345-0@lo:502: 00000100:00100000:0.0:1789061421.002547:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000095833506 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:6398:x1875966779462144:12345-0@lo:502: Request processed in 290us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061421.002557:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789061421.002930:0:6398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ac50179 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:6398:1875966779462144:0@lo:502: 00000020:01000000:3.0:1789061421.002973:0:6398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061421.002985:0:6398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061421.002995:0:6398:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789061421.003003:0:6398:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff971a46ca8000 00000020:00000080:3.0:1789061421.003006:0:6398:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789061421.003066:0:6398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:6398:1875966779462272:0@lo:502: 00000100:00100000:3.0:1789061421.003111:0:6398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061421.003157:0:6398:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a45634480 going to sleep for 11 seconds 00000100:00100000:2.0:1789061421.015951:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779462272 00000100:00100000:2.0:1789061421.015968:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779462272 00000100:00100000:2.0:1789061421.016163:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789061421.016175:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:6398:x1875966779462272:12345-0@lo:502: 00000100:00100000:2.0:1789061421.016578:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:6398:x1875966779462272:12345-0@lo:502: Request processed in 403us (13464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061421.016586:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789061421.019052:0:6398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:6398:1875966779462272:0@lo:502: 00000020:01000000:3.0:1789061421.019123:0:6398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061421.019148:0:6398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061421.019151:0:6398:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789061421.019157:0:6398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789061421.019504:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789061421.019528:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789061421.019542:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a508 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a50f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061421.019555:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a50f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061421.952694:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061422.983775:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061423.361001:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779462400:0@lo:400: 00000100:00100000:1.0:1789061423.361087:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061423.362045:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779462400 00000100:00100000:2.0:1789061423.362057:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779462400 00000100:00100000:2.0:1789061423.362129:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789061423.362142:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:3312:x1875966779462400:12345-0@lo:400: 00000100:00100000:2.0:1789061423.362207:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:3312:x1875966779462400:12345-0@lo:400: Request processed in 68us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061423.362215:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789061423.362300:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779462400:0@lo:400: 00000100:00100000:1.0:1789061423.362322:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061423.362331:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779462528:0@lo:400: 00000100:00100000:1.0:1789061423.362365:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061423.362613:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779462528 00000100:00100000:2.0:1789061423.362618:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779462528 00000100:00100000:2.0:1789061423.362693:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789061423.362703:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779462528:12345-0@lo:400: 00000100:00100000:2.0:1789061423.362761:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779462528:12345-0@lo:400: Request processed in 60us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061423.362769:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789061423.362829:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff971a76194700 x1875966779462528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061423.362843:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779462528:0@lo:400: 00010000:00010000:2.0:1789061423.999404:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061425.023931:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789061425.416046:0:6697:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789061425.416062:0:6697:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789061425.416193:0:6697:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff971a7618e800 00000020:01000004:2.0:1789061425.416208:0:6697:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789061425.416219:0:6697:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789061425.416233:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff971a4d660000) 00000020:00000080:2.0:1789061425.416248:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789061425.428965:0:6697:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789061425.429223:0:6697:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789061425.461823:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789061425.468959:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789061425.468995:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789061425.469062:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789061425.469103:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789061425.469570:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789061425.469588:0:6697:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789061425.469634:0:6697:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x427fa11dc4a9a51d 00000020:01000004:1.0:1789061425.469643:0:6697:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789061425.469781:0:6697:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789061425.469785:0:6697:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789061425.469791:0:6697:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789061425.469796:0:6697:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789061425.469814:0:6697:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff971a7c730000) 00000020:00000080:1.0:1789061425.469825:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1789061425.471189:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789061425.471397:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789061425.471403:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789061425.481557:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789061425.481574:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789061425.490886:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789061425.490905:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789061425.498194:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789061425.498384:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789061425.498390:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789061425.501730:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789061425.501758:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789061425.566435:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789061425.566725:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789061425.566732:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789061425.576441:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789061425.579410:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789061425.593939:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789061425.593963:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789061425.595893:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061425.596089:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789061425.596095:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789061425.596818:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789061425.596825:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789061425.719251:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789061425.721729:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789061425.721744:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789061425.739009:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789061425.739035:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789061425.739775:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789061425.739800:0:6697:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789061425.739806:0:6697:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789061425.795284:0:6697:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789061425.795323:0:6697:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789061425.795327:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789061425.795329:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789061425.795331:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061425.795332:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061425.795333:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061425.795334:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061425.795336:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061425.795337:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789061425.795339:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789061425.795341:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061425.795342:0:6697:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789061425.795345:0:6697:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789061425.795353:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789061425.795354:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789061425.795355:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061425.795356:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061425.795357:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061425.795358:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061425.795359:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061425.795360:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789061425.795360:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789061425.795361:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061425.795362:0:6697:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789061425.795388:0:6697:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789061425.795407:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76197b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779462656:0@lo:253: 00000100:00100000:2.0:1789061425.796151:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061425.796245:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a461a9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789061425.802738:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779462656 00000100:00100000:1.0:1789061425.802756:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779462656 00000100:00100000:1.0:1789061425.802827:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789061425.802839:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:6697:x1875966779462656:12345-0@lo:253: 20000000:01000000:1.0:1789061425.802905:0:5845:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789061425.802910:0:5845:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789061425.802924:0:5845:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789061425.802928:0:5845:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789061425.803958:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789061425.804175:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789061425.804188:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789061425.804227:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1789061425.804234:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789061425.804265:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1789061425.804314:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1789061425.806213:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789061425.806244:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:1.0:1789061425.806246:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:1.0:1789061425.806285:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789061425.806294:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789061425.806345:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789061425.806353:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:1.0:1789061425.806388:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789061425.806397:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789061425.808660:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789061425.811824:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789061425.812682:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789061425.812706:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:0.0:1789061425.812709:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:0.0:1789061425.812742:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789061425.812750:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789061425.812777:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789061425.812784:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:0.0:1789061425.812826:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789061425.812836:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789061425.812866:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789061425.812898:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789061425.812913:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789061425.812916:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789061425.812920:0:5845:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789061425.812933:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789061425.812935:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789061425.812969:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789061425.812972:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789061425.813655:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789061425.813707:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789061425.813761:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789061425.814120:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789061425.814159:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789061425.814210:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789061425.814224:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789061425.814226:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789061425.814683:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789061425.814726:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789061425.814771:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789061425.815026:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789061425.815078:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789061425.815114:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789061425.815134:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789061425.815136:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789061425.815752:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789061425.815964:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789061425.816002:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789061425.816089:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1789061425.816105:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789061425.816107:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789061425.816115:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789061425.816135:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.816154:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a43d expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.816162:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a459 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.816170:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a4d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a4c9 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.816177:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.816218:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a4c9 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.816234:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a4d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4c9 expref: 12 pid: 5845 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061425.816248:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875966779462784:0@lo:104: 00000100:00100000:0.0:1789061425.816311:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061425.816376:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a459 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.816391:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a460 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a459 expref: 12 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061425.816401:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875966779462912:0@lo:104: 00000100:00100000:0.0:1789061425.816425:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061425.816455:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a43d expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.816463:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a444 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a43d expref: 12 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061425.816471:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875966779463040:0@lo:104: 00000100:00100000:3.0:1789061425.816633:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779462784 00000100:00100000:3.0:1789061425.816642:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779462784 00000100:00100000:3.0:1789061425.816673:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779462912 00000100:00100000:3.0:1789061425.816676:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779462912 00000100:00100000:3.0:1789061425.816688:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789061425.816697:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+4:5845:x1875966779462784:12345-0@lo:104: 00010000:00010000:3.0:1789061425.816711:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a4c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a4d0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061425.819980:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789061425.820022:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+4:5845:x1875966779462784:12345-0@lo:104: Request processed in 3322us (3706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061425.820036:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789061425.820087:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061425.820098:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+3:5845:x1875966779462912:12345-0@lo:104: 00010000:00010000:3.0:1789061425.820114:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a460 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061425.820169:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789061425.820174:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+3:5845:x1875966779462912:12345-0@lo:104: Request processed in 80us (3749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061425.820180:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789061425.820266:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789061425.820274:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a4c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a4d0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820281:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1789061425.820286:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a4c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a4d0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820295:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a4c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a4d0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061425.820302:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a4c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a4d0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061425.820308:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061425.820356:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a4c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a4d0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820363:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061425.820390:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a4c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a4d0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820396:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a4c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a4d0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820413:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061425.820416:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a460 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820422:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc85c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1789061425.820425:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a460 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820432:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a460 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061425.820439:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a460 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061425.820444:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061425.820457:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a459 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a460 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820462:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061425.820467:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a459 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a460 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820473:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a459 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a460 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820484:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061425.820550:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779463168:0@lo:103: 00000100:00100000:2.0:1789061425.820589:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061425.820629:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061425.820635:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779463296:0@lo:103: 00000100:00100000:2.0:1789061425.820656:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061425.820687:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779463168 00000100:00100000:2.0:1789061425.820694:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779463168 00010000:00010000:2.0:1789061425.820717:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a4d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4c9 expref: 13 pid: 5845 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061425.820739:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779463296 00000100:00100000:2.0:1789061425.820742:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779463296 00010000:00010000:2.0:1789061425.820768:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a460 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a459 expref: 14 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061425.820782:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061425.820788:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76197480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+14:3310:x1875966779463168:12345-0@lo:103: 00010000:00010000:2.0:1789061425.820798:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061425.820803:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a4d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4c9 expref: 14 pid: 5845 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820813:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a4d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4c9 expref: 14 pid: 5845 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820830:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061425.820857:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76197480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+14:3310:x1875966779463168:12345-0@lo:103: Request processed in 69us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061425.820865:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061425.820880:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789061425.820886:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+13:3310:x1875966779463296:12345-0@lo:103: 00010000:00010000:2.0:1789061425.820898:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061425.820902:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a460 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a459 expref: 13 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820910:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a460 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a459 expref: 13 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.820919:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061425.820941:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+13:3310:x1875966779463296:12345-0@lo:103: Request processed in 55us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061425.820947:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789061425.820983:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779463296:0@lo:103: 00000100:00100000:2.0:1789061425.820992:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779463168:0@lo:103: 00010000:00010000:2.0:1789061425.821010:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061425.821013:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061425.821139:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061425.821185:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a460f0d80 going to sleep for 11 seconds 00010000:00010000:0.0:1789061425.821199:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a4d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a4c9 expref: 12 pid: 5845 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061425.821210:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875966779462784:0@lo:104: 00010000:00010000:0.0:1789061425.821219:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a460 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a459 expref: 11 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061425.821229:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875966779462912:0@lo:104: 00010000:00010000:1.0:1789061425.821304:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061425.821358:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779463040 00000100:00100000:3.0:1789061425.821362:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779463040 00000100:00100000:3.0:1789061425.821396:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789061425.821404:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+3:5845:x1875966779463040:12345-0@lo:104: 00010000:00010000:3.0:1789061425.821413:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a4cc84e00/0x427fa11dc4a9a43d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a444 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061425.821533:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875966779463040:0@lo:104: 00010000:00010000:0.0:1789061425.821552:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061425.821639:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789061425.821646:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+3:5845:x1875966779463040:12345-0@lo:104: Request processed in 244us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061425.821653:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789061425.827648:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061425.827662:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4cc84e00/0x427fa11dc4a9a43d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a444 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.827674:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc84e00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1789061425.827679:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84e00/0x427fa11dc4a9a43d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a444 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.827690:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4cc84e00/0x427fa11dc4a9a43d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a444 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061425.827699:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84e00/0x427fa11dc4a9a43d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a444 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061425.827728:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061425.827929:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a4cc84e00/0x427fa11dc4a9a43d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a444 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.827937:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061425.827968:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4cc84e00/0x427fa11dc4a9a43d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a444 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.827976:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4cc84e00/0x427fa11dc4a9a43d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a444 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.827999:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061425.828001:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061425.828003:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061425.828039:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061425.828071:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779463424:0@lo:103: 00000100:00100000:3.0:1789061425.828138:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061425.828274:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779463424 00000100:00100000:2.0:1789061425.828283:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779463424 00010000:00010000:2.0:1789061425.828312:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a444 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a43d expref: 11 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061425.828349:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789061425.828358:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+11:3313:x1875966779463424:12345-0@lo:103: 00010000:00010000:2.0:1789061425.828370:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061425.828375:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a444 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a43d expref: 11 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.828385:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a43d expref: 11 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.828399:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a444 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a43d expref: 11 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.828421:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.828430:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.828445:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.828453:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.828460:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.828466:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.828471:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061425.828475:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.828482:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.828532:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.828541:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061425.828578:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+10:3313:x1875966779463424:12345-0@lo:103: Request processed in 221us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061425.828593:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789061425.828789:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061425.828799:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061425.828806:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a40030800/0x427fa11dc4a9a52b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789061425.828820:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789061425.829594:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779463424:0@lo:103: 00000100:00100000:1.0:1789061425.936522:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+9:6697:x1875966779462656:12345-0@lo:253: Request processed in 133676us (140364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061425.936559:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789061425.940113:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76197b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779462656:0@lo:253: 10000000:01000000:2.0:1789061425.940134:0:6697:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789061425.940137:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789061425.940139:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789061425.940140:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061425.940141:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789061425.940143:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061425.940144:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061425.940145:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061425.940147:0:6697:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789061425.940148:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061425.940150:0:6697:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789061425.940177:0:6697:0:(tgt_mount.c:101:server_register_mount()) register mount ffff971a7618e800 from lustre-OST0000 10000000:01000000:2.0:1789061425.940203:0:6697:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789061425.940205:0:6697:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789061425.940212:0:6697:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff971a47d64d40 local copy 10000000:01000000:2.0:1789061425.940227:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789061425.940267:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.940277:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.940286:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061425.940304:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76197b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779463552:0@lo:101: 00000100:00100000:2.0:1789061425.940599:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061425.940729:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061425.942776:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779463552 00000100:00100000:0.0:1789061425.942804:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779463552 00000100:00100000:0.0:1789061425.942873:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789061425.942882:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+9:6697:x1875966779463552:12345-0@lo:101: 00010000:00010000:0.0:1789061425.942898:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061425.942918:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a539 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a532 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.942947:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a532 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.942958:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a532 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.942966:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40031800, rc 0) 00000100:00100000:0.0:1789061425.943117:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+10:6697:x1875966779463552:12345-0@lo:101: Request processed in 236us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061425.943124:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789061425.945550:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76197b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779463552:0@lo:101: 00010000:00010000:3.0:1789061425.945581:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x427fa11dc4a9a539 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061425.945611:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x427fa11dc4a9a539 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061425.949687:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779463680:0@lo:501: 00000100:00100000:0.0:1789061425.949760:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061425.949858:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bd240 going to sleep for 11 seconds 00000100:00100000:1.0:1789061425.953746:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779463680 00000100:00100000:1.0:1789061425.954281:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779463680 00000100:00100000:1.0:1789061425.954420:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789061425.954581:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+10:6697:x1875966779463680:12345-0@lo:501: 00000100:00100000:1.0:1789061425.954896:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+10:6697:x1875966779463680:12345-0@lo:501: Request processed in 319us (5134us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789061425.954904:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789061425.955007:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779463680:0@lo:501: 10000000:01000000:2.0:1789061425.955029:0:6697:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789061425.955082:0:6697:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789061425.955091:0:6697:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x427fa11dc4a9a539 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.955101:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x427fa11dc4a9a539 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.955107:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x427fa11dc4a9a539 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.955136:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789061425.955160:0:6697:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff971a7618e800 10000000:01000000:2.0:1789061425.955165:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789061425.955171:0:6697:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff971a47d64d40 10000000:01000000:2.0:1789061425.955174:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789061425.955177:0:6697:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff971a47d64d40 from 1 10000000:01000000:2.0:1789061425.955179:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789061425.955207:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9a540 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.955214:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9a540 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.955235:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9a540 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061425.955252:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779463808:0@lo:101: 00000100:00100000:2.0:1789061425.955282:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789061425.955338:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061425.955346:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x427fa11dc4a9a539 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061425.955362:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042000 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1789061425.955367:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x427fa11dc4a9a539 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061425.955375:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x427fa11dc4a9a539 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061425.955382:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x427fa11dc4a9a539 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061425.955388:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789061425.955407:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x427fa11dc4a9a539 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061425.955412:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061425.955445:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x427fa11dc4a9a539 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061425.955452:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9a532 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x427fa11dc4a9a539 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061425.955467:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061425.955473:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061425.955475:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061425.955528:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779463936:0@lo:103: 00000100:00100000:3.0:1789061425.955556:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061425.958586:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061425.961658:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779463808 00000100:00100000:0.0:1789061425.961677:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779463808 00000100:00100000:0.0:1789061425.961742:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789061425.961752:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+10:6697:x1875966779463808:12345-0@lo:101: 00010000:00010000:0.0:1789061425.961769:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061425.961791:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a40031000/0x427fa11dc4a9a547 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a540 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.961819:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a40031000/0x427fa11dc4a9a547 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a540 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.961847:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a40031000/0x427fa11dc4a9a547 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a540 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.961856:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40031000, rc 0) 00000100:00100000:0.0:1789061425.961944:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+11:6697:x1875966779463808:12345-0@lo:101: Request processed in 193us (6660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061425.961950:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789061425.962309:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779463808:0@lo:101: 00010000:00010000:2.0:1789061425.962329:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9a540 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a547 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.962339:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9a540 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a547 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061425.962362:0:6697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789061425.962379:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9a540 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a547 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.962387:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9a540 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a547 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061425.962396:0:6697:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789061425.962402:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789061425.962409:0:6697:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789061425.962411:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789061425.962438:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.962446:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.962455:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061425.962473:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464064:0@lo:101: 00000100:00100000:2.0:1789061425.962532:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061425.962570:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061425.962646:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779464064 00000100:00100000:0.0:1789061425.962651:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779464064 00000100:00100000:0.0:1789061425.962673:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789061425.962679:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+11:6697:x1875966779464064:12345-0@lo:101: 00010000:00010000:0.0:1789061425.962686:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061425.962696:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a555 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a54e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.962709:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a54e expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.962717:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a54e expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061425.962724:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40031400, rc 0) 00000100:00100000:0.0:1789061425.962811:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:6697:x1875966779464064:12345-0@lo:101: Request processed in 131us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061425.962817:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789061425.963014:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779463936 00000100:00100000:1.0:1789061425.963019:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779463936 00000100:00100000:1.0:1789061425.963070:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061425.963078:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+12:3313:x1875966779463936:12345-0@lo:103: 00010000:00010000:1.0:1789061425.963088:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061425.963104:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a539 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a532 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061425.963118:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061425.963154:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+11:3313:x1875966779463936:12345-0@lo:103: Request processed in 78us (7597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061425.963160:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061425.963188:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779463936:0@lo:103: 00000100:00100000:2.0:1789061425.966896:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464064:0@lo:101: 00010000:00010000:2.0:1789061425.966927:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a555 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061425.966940:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a555 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061425.967088:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464192:0@lo:501: 00000100:00100000:2.0:1789061425.967150:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061425.967183:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061425.967258:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779464192 00000100:00100000:0.0:1789061425.967266:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779464192 00000100:00100000:0.0:1789061425.967353:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789061425.967379:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+11:6697:x1875966779464192:12345-0@lo:501: 00000100:00100000:0.0:1789061425.967647:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+11:6697:x1875966779464192:12345-0@lo:501: Request processed in 269us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061425.967654:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789061425.967731:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464192:0@lo:501: 00000100:00100000:2.0:1789061425.967760:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464320:0@lo:503: 00000100:00100000:2.0:1789061425.967798:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061425.974241:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061425.974339:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779464320 00000100:00100000:3.0:1789061425.974350:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779464320 00000100:00100000:3.0:1789061425.974407:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789061425.974417:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+11:6697:x1875966779464320:12345-0@lo:503: 00000100:00100000:3.0:1789061425.974671:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+11:6697:x1875966779464320:12345-0@lo:503: Request processed in 255us (6872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061425.974679:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789061425.974796:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464320:0@lo:503: 00000040:00080000:2.0:1789061425.975103:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789061425.975189:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464448:0@lo:502: 00000100:00100000:2.0:1789061425.975235:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061425.975271:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061425.975340:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779464448 00000100:00100000:3.0:1789061425.975346:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779464448 00000100:00100000:3.0:1789061425.975368:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789061425.975374:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+11:6697:x1875966779464448:12345-0@lo:502: 00000100:00100000:3.0:1789061425.975548:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+11:6697:x1875966779464448:12345-0@lo:502: Request processed in 173us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061425.975557:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789061425.978548:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464448:0@lo:502: 00000040:00080000:2.0:1789061425.978907:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789061425.978986:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789061425.979023:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789061425.979084:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789061425.979120:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789061425.979155:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789061425.979201:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464576:0@lo:502: 00000100:00100000:2.0:1789061425.979274:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061425.979321:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061425.979575:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779464576 00000100:00100000:3.0:1789061425.979583:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779464576 00000100:00100000:3.0:1789061425.979625:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789061425.979634:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+11:6697:x1875966779464576:12345-0@lo:502: 00000100:00100000:3.0:1789061425.979841:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+11:6697:x1875966779464576:12345-0@lo:502: Request processed in 206us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061425.979848:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789061425.980088:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464576:0@lo:502: 00000040:00080000:2.0:1789061425.980183:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789061425.980194:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1789061425.981005:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789061425.981014:0:6715:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789061425.981020:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061425.981023:0:6715:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789061425.981028:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789061425.981053:0:6715:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff971a4d663380) 00000020:00000080:2.0:1789061425.981072:0:6715:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789061425.981079:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789061425.981149:0:6715:0:(tgt_mount.c:153:server_get_mount()) get mount ffff971a7618e800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789061425.981155:0:6715:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789061425.981162:0:6715:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x427fa11dc4a9a563 00010000:00010000:2.0:1789061425.992195:0:6715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789061425.992698:0:6715:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789061425.998468:0:6715:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789061425.998895:0:6715:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789061426.013190:0:6715:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789061426.013860:0:6715:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789061426.015238:0:6715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789061426.015250:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061426.015256:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061426.015258:0:6715:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789061426.015261:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061426.015265:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061426.015266:0:6715:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789061426.015269:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789061426.015281:0:6715:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789061426.015325:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061426.015328:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061426.015330:0:6715:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789061426.015333:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789061426.015673:0:6697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789061426.015697:0:6697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789061426.015720:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a555 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.015731:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a555 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061426.015747:0:6697:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a7618e800 from 1 10000000:01000000:1.0:1789061426.015750:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789061426.015786:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.015795:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.015806:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061426.015828:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464704:0@lo:101: 00000100:00100000:1.0:1789061426.015896:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.015947:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a461a9240 going to sleep for 11 seconds 00000100:00100000:2.0:1789061426.016102:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779464704 00000100:00100000:2.0:1789061426.016111:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779464704 00000100:00100000:2.0:1789061426.016156:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789061426.016166:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+11:6697:x1875966779464704:12345-0@lo:101: 00010000:00010000:2.0:1789061426.016179:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061426.016192:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a82042000/0x427fa11dc4a9a571 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a56a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061426.016213:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a82042000/0x427fa11dc4a9a571 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a56a expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061426.016237:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a82042000/0x427fa11dc4a9a571 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a56a expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061426.016246:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042000, rc 0) 00000100:00100000:2.0:1789061426.016294:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:6697:x1875966779464704:12345-0@lo:101: Request processed in 129us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061426.016301:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789061426.016473:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464704:0@lo:101: 00010000:00010000:1.0:1789061426.016519:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a571 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.016529:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a571 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061426.016613:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464832:0@lo:501: 00000100:00100000:1.0:1789061426.016637:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.016655:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a461a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061426.016718:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779464832 00000100:00100000:3.0:1789061426.016723:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779464832 00000100:00100000:3.0:1789061426.016752:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789061426.016767:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:6697:x1875966779464832:12345-0@lo:501: 00000100:00100000:3.0:1789061426.016969:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:6697:x1875966779464832:12345-0@lo:501: Request processed in 203us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061426.016977:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789061426.017075:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464832:0@lo:501: 00000100:00100000:1.0:1789061426.017098:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464960:0@lo:503: 00000100:00100000:1.0:1789061426.017138:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.017155:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a461a9240 going to sleep for 11 seconds 00000100:00100000:2.0:1789061426.017241:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779464960 00000100:00100000:2.0:1789061426.017246:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779464960 00000100:00100000:2.0:1789061426.017264:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789061426.017270:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:6697:x1875966779464960:12345-0@lo:503: 00000100:00100000:2.0:1789061426.017620:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:6697:x1875966779464960:12345-0@lo:503: Request processed in 349us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061426.017627:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789061426.017718:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779464960:0@lo:503: 00000040:00080000:1.0:1789061426.017968:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789061426.018034:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465088:0@lo:502: 00000100:00100000:1.0:1789061426.018080:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.018111:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a461a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061426.018312:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779465088 00000100:00100000:3.0:1789061426.018318:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779465088 00000100:00100000:3.0:1789061426.018345:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789061426.018351:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:6697:x1875966779465088:12345-0@lo:502: 00000100:00100000:3.0:1789061426.018764:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:6697:x1875966779465088:12345-0@lo:502: Request processed in 411us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061426.018771:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789061426.018875:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465088:0@lo:502: 00000040:00080000:1.0:1789061426.019138:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789061426.019187:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789061426.019214:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465216:0@lo:502: 00000100:00100000:1.0:1789061426.020557:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.020596:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a461a9240 going to sleep for 11 seconds 00000100:00100000:2.0:1789061426.020708:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779465216 00000100:00100000:2.0:1789061426.020717:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779465216 00000100:00100000:2.0:1789061426.020759:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789061426.020769:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:6697:x1875966779465216:12345-0@lo:502: 00000100:00100000:2.0:1789061426.020961:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:6697:x1875966779465216:12345-0@lo:502: Request processed in 193us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061426.020970:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789061426.021162:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465216:0@lo:502: 00000040:00080000:1.0:1789061426.021538:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789061426.021553:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789061426.026605:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061426.026619:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061426.026621:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789061426.026628:0:6718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff971a7618e800 00000020:00000080:2.0:1789061426.026631:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789061426.026650:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061426.026653:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061426.026654:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789061426.026658:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789061426.026816:0:6697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789061426.026841:0:6697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789061426.026864:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a571 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.026877:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a571 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061426.026921:0:6697:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789061426.026924:0:6697:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff971a7618e800 10000000:01000000:3.0:1789061426.026928:0:6697:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff971a7618e800 10000000:01000000:3.0:1789061426.026932:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789061426.026938:0:6697:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff971a7618e800 from 1 10000000:01000000:3.0:1789061426.026941:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789061426.026979:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.026988:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.027013:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061426.027037:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465344:0@lo:101: 00000100:00100000:3.0:1789061426.027117:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061426.027161:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779465344 00000100:00100000:3.0:1789061426.027168:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779465344 00000100:00100000:3.0:1789061426.027206:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789061426.027214:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:6697:x1875966779465344:12345-0@lo:101: 00010000:00010000:3.0:1789061426.027240:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061426.027252:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a57f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a578 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.027274:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a578 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.027284:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a578 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.027293:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41477e00, rc 0) 00000100:00100000:3.0:1789061426.027324:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+13:6697:x1875966779465344:12345-0@lo:101: Request processed in 111us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061426.027330:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789061426.027529:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a79f48b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789061426.027555:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465344:0@lo:101: 00010000:00010000:3.0:1789061426.027569:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a57f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.027589:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a57f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061426.027673:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465472:0@lo:501: 00000100:00100000:3.0:1789061426.027697:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061426.033171:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a79f48b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061426.033428:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779465472 00000100:00100000:2.0:1789061426.033438:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779465472 00000100:00100000:2.0:1789061426.034483:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789061426.034513:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:6697:x1875966779465472:12345-0@lo:501: 00000100:00100000:2.0:1789061426.034846:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:6697:x1875966779465472:12345-0@lo:501: Request processed in 338us (7145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061426.034853:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789061426.036868:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465472:0@lo:501: 00000100:00100000:3.0:1789061426.036924:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465600:0@lo:503: 00000100:00100000:3.0:1789061426.036990:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061426.037034:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a79f48b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061426.037337:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779465600 00000100:00100000:0.0:1789061426.037344:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779465600 00000100:00100000:0.0:1789061426.037462:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789061426.037472:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:6697:x1875966779465600:12345-0@lo:503: 00000100:00100000:0.0:1789061426.037682:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:6697:x1875966779465600:12345-0@lo:503: Request processed in 211us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061426.037689:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789061426.038349:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465600:0@lo:503: 00000040:00080000:3.0:1789061426.038777:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789061426.038855:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465728:0@lo:502: 00000100:00100000:3.0:1789061426.038902:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061426.038935:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a5cdfacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061426.039058:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779465728 00000100:00100000:2.0:1789061426.039064:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779465728 00000100:00100000:2.0:1789061426.039092:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789061426.039099:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:6697:x1875966779465728:12345-0@lo:502: 00000100:00100000:2.0:1789061426.039336:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:6697:x1875966779465728:12345-0@lo:502: Request processed in 236us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061426.039422:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789061426.039517:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465728:0@lo:502: 00000040:00080000:2.0:1789061426.039772:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789061426.039821:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789061426.039854:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789061426.039897:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789061426.039934:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789061426.039981:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789061426.040020:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789061426.040067:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789061426.040119:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789061426.040172:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789061426.040207:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789061426.041874:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789061426.041925:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789061426.041962:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789061426.042035:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789061426.042088:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789061426.042121:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789061426.042171:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789061426.042207:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789061426.042434:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789061426.043329:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789061426.043457:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789061426.043667:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789061426.043743:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789061426.043784:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789061426.043821:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789061426.043871:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789061426.043904:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1789061426.043953:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465856:0@lo:502: 00000100:00100000:0.0:1789061426.044055:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061426.044132:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a460f00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061426.044182:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779465856 00000100:00100000:2.0:1789061426.044190:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779465856 00000100:00100000:2.0:1789061426.044381:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789061426.044392:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:6697:x1875966779465856:12345-0@lo:502: 00000100:00100000:2.0:1789061426.044662:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:6697:x1875966779465856:12345-0@lo:502: Request processed in 270us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061426.044670:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789061426.044762:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779465856:0@lo:502: 00000040:00080000:0.0:1789061426.044834:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789061426.044845:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789061426.045859:0:6720:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789061426.045882:0:6720:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9719450519c0) 00000020:00000080:0.0:1789061426.045904:0:6720:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789061426.045983:0:6720:0:(tgt_mount.c:153:server_get_mount()) get mount ffff971a7618e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789061426.045987:0:6720:0:(tgt_mount.c:187:server_put_mount()) put mount ffff971a7618e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789061426.045990:0:6720:0:(obd_mount.c:710:lustre_put_lsi()) put ffff971a7618e800 3 00010000:00080000:0.0:1789061426.046018:0:6720:0:(ldlm_lib.c:102:import_set_conn()) imp ffff971945059000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1789061426.047629:0:6720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789061426.047830:0:6720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789061426.047862:0:6720:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789061426.047873:0:6720:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x427fa11dc4a9a58d 00000100:00080000:0.0:1789061426.047883:0:6720:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789061426.047893:0:6720:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff971945059000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789061426.047929:0:6720:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971a7c2b7480 x1875966779465984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789061426.047949:0:6720:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789061426.048171:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875966779465984:0@lo:38: 00000100:00100000:1.0:1789061426.048238:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061426.053424:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779465984 00000100:00100000:2.0:1789061426.053438:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779465984 00000100:00100000:2.0:1789061426.053482:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061426.053514:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875966779465984:12345-0@lo:38: 00010000:00080000:2.0:1789061426.053541:0:5853:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1789061426.053579:0:5853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x427fa11dc4a9a594 00000004:00100000:2.0:1789061426.053596:0:5853:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789061426.053627:0:5853:0:(import.c:65:import_set_state_nolock()) ffff971944d9c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789061426.053728:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875966779465984:12345-0@lo:38: Request processed in 214us (5488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061426.053736:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789061426.053802:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff971a7c2b7480 x1875966779465984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789061436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061426.053813:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789061426.053822:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789061426.053830:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789061426.053835:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789061426.053837:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971945059000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789061426.053843:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875966779465984:0@lo:38: 00000040:00080000:2.0:1789061426.053997:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1789061426.054230:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061426.054244:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779466112:0@lo:400: 00000100:00100000:1.0:1789061426.054283:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1789061426.054437:0:6697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789061426.054464:0:6697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789061426.054477:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a57f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.054522:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a57f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789061426.054569:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789061426.054571:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789061426.054572:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061426.054573:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789061426.054575:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061426.054576:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061426.054577:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789061426.054579:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789061426.054580:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789061426.054582:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061426.054583:0:6697:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789061426.054587:0:6697:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789061426.054589:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789061426.054590:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789061426.054591:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061426.054592:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789061426.054593:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061426.054594:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061426.054595:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789061426.054596:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789061426.054598:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789061426.054599:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061426.054600:0:6697:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789061426.054615:0:6697:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789061426.054626:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779466240:0@lo:253: 00000100:00100000:1.0:1789061426.054658:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.054684:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a461a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061426.055521:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779466112 00000100:00100000:3.0:1789061426.055530:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779466112 00000100:00100000:3.0:1789061426.055573:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789061426.055582:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779466112:12345-0@lo:400: 00000100:00100000:3.0:1789061426.055645:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779466112:12345-0@lo:400: Request processed in 64us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061426.055652:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789061426.055695:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a76194380 x1875966779466112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061426.055709:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779466112:0@lo:400: 00010000:00010000:2.0:1789061426.055895:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061426.056031:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779466240 00000100:00100000:0.0:1789061426.056036:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779466240 00000100:00100000:0.0:1789061426.056073:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789061426.056081:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:6697:x1875966779466240:12345-0@lo:253: 20000000:01000000:0.0:1789061426.056103:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789061426.056117:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789061426.097925:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789061426.097945:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789061426.098058:0:5867:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789061426.098063:0:5867:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789061426.098090:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061426.098109:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a4fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a4f3 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061426.098117:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061426.098159:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a4fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a4f3 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061426.098175:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a4fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4f3 expref: 13 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061426.098212:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76196300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1875966779466368:0@lo:104: 00000100:00100000:2.0:1789061426.098279:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061426.098795:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789061426.099925:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779466368 00000100:00100000:3.0:1789061426.099937:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779466368 00000100:00100000:3.0:1789061426.099994:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789061426.100005:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76196680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+3:5867:x1875966779466368:12345-0@lo:104: 00010000:00010000:3.0:1789061426.100020:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a4f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a4fa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100109:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789061426.100115:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76196680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+3:5867:x1875966779466368:12345-0@lo:104: Request processed in 113us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061426.100121:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789061426.100141:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061426.100146:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a4f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a4fa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100153:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1789061426.100157:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a4f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a4fa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100165:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a4f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a4fa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061426.100171:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a4f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a4fa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061426.100177:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789061426.100206:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a4f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a4fa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100212:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061426.100239:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a4f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a4fa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100247:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a4f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a4fa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100263:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061426.100265:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061426.100267:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061426.100288:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779466496:0@lo:103: 00000100:00100000:3.0:1789061426.100327:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061426.100456:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76196300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1875966779466368:0@lo:104: 00010000:00010000:0.0:1789061426.100484:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061426.100619:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779466496 00000100:00100000:3.0:1789061426.100624:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779466496 00010000:00010000:3.0:1789061426.100643:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a4fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4f3 expref: 14 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061426.100667:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789061426.100673:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+14:3311:x1875966779466496:12345-0@lo:103: 00010000:00010000:3.0:1789061426.100684:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061426.100689:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a4fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4f3 expref: 14 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100699:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a4fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a4f3 expref: 14 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100712:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a4fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a4f3 expref: 14 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100725:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100744:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789061426.100757:0:5837:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002694636s 00010000:00010000:3.0:1789061426.100762:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100769:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100775:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100782:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100788:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061426.100792:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100799:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100812:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.100821:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061426.100850:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+13:3311:x1875966779466496:12345-0@lo:103: Request processed in 177us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061426.100857:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789061426.100922:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779466496:0@lo:103: 00010000:00010000:1.0:1789061426.101726:0:5867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.101748:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.101754:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a82042400/0x427fa11dc4a9a59b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061426.105480:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:6697:x1875966779466240:12345-0@lo:253: Request processed in 49391us (50812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061426.105510:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789061426.105658:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:6697:1875966779466240:0@lo:253: 10000000:01000000:0.0:1789061426.105675:0:6697:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789061426.105678:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789061426.105680:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789061426.105682:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061426.105683:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061426.105685:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061426.105686:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061426.105687:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789061426.105689:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789061426.105691:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789061426.105693:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061426.105694:0:6697:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789061426.105708:0:6697:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789061426.114014:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789061426.114238:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789061426.114628:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789061426.114840:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789061426.115202:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789061426.115604:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789061426.116818:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789061426.351124:0:6697:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789061426.351136:0:6697:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789061426.351180:0:6697:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789061426.351254:0:6697:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789061426.351272:0:6697:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789061426.351307:0:6697:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:2.0:1789061426.389696:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789061426.389704:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff971a46ca8000 from 21 10000000:01000000:2.0:1789061426.389709:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789061426.389755:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061426.389767:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061426.389780:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061426.389806:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779466624:0@lo:101: 00000100:00100000:2.0:1789061426.389876:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061426.389945:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4f437300 going to sleep for 11 seconds 00000100:00100000:3.0:1789061426.389988:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779466624 00000100:00100000:3.0:1789061426.389996:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779466624 00000100:00100000:3.0:1789061426.390055:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789061426.390064:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:5848:x1875966779466624:12345-0@lo:101: 00010000:00010000:3.0:1789061426.390077:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061426.390088:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a5a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a5a2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.390110:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a5a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a5a2 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.390120:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a5a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a5a2 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.390128:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476000, rc 0) 00000100:00100000:3.0:1789061426.390176:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:5848:x1875966779466624:12345-0@lo:101: Request processed in 113us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061426.390182:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789061426.390275:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779466624:0@lo:101: 00010000:00010000:0.0:1789061426.390289:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a5a9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061426.390308:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a5a9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061426.390360:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779466752:0@lo:501: 00000100:00100000:0.0:1789061426.390385:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061426.390408:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ceff000 going to sleep for 11 seconds 00000100:00100000:3.0:1789061426.390537:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779466752 00000100:00100000:3.0:1789061426.390543:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779466752 00000100:00100000:3.0:1789061426.390577:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789061426.390584:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:5848:x1875966779466752:12345-0@lo:501: 00000100:00100000:3.0:1789061426.390841:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:5848:x1875966779466752:12345-0@lo:501: Request processed in 257us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061426.390849:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789061426.399023:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779466752:0@lo:501: 00000100:00100000:0.0:1789061426.399102:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779466880:0@lo:503: 00000100:00100000:0.0:1789061426.399178:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061426.399223:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ceff000 going to sleep for 11 seconds 00000100:00100000:1.0:1789061426.399390:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779466880 00000100:00100000:1.0:1789061426.399397:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779466880 00000100:00100000:1.0:1789061426.399459:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789061426.399469:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:5848:x1875966779466880:12345-0@lo:503: 00000100:00100000:1.0:1789061426.399964:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:5848:x1875966779466880:12345-0@lo:503: Request processed in 494us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061426.399973:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789061426.400364:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779466880:0@lo:503: 00000100:00100000:2.0:1789061426.403002:0:6726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76195500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:6726:1875966779467008:0@lo:502: 00000100:00100000:2.0:1789061426.403284:0:6726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061426.403338:0:6726:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a460f2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061426.403363:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779467008 00000100:00100000:1.0:1789061426.403374:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779467008 00000100:00100000:1.0:1789061426.403431:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789061426.403441:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:6726:x1875966779467008:12345-0@lo:502: 00000100:00100000:1.0:1789061426.403778:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:6726:x1875966779467008:12345-0@lo:502: Request processed in 339us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061426.403786:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789061426.404002:0:6726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76195500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:6726:1875966779467008:0@lo:502: 00000100:00100000:2.0:1789061426.404067:0:6726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76195500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:6726:1875966779467136:0@lo:502: 00000100:00100000:2.0:1789061426.404101:0:6726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061426.404129:0:6726:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a460f2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061426.404178:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779467136 00000100:00100000:1.0:1789061426.404183:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779467136 00000100:00100000:1.0:1789061426.404214:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789061426.404221:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:6726:x1875966779467136:12345-0@lo:502: 00000100:00100000:1.0:1789061426.404340:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:6726:x1875966779467136:12345-0@lo:502: Request processed in 119us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061426.404346:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789061426.404429:0:6726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76195500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:6726:1875966779467136:0@lo:502: 00000040:00080000:2.0:1789061426.404453:0:6726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789061426.404740:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789061426.404759:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789061426.404769:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a5a9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.404780:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a5a9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061426.404789:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789061426.404792:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff971a46ca8000 from 4 10000000:01000000:1.0:1789061426.404795:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789061426.404818:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.404826:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.404834:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061426.404845:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779467264:0@lo:101: 00000100:00100000:1.0:1789061426.404870:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.404930:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a433b4300 going to sleep for 11 seconds 00000100:00100000:2.0:1789061426.408667:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779467264 00000100:00100000:2.0:1789061426.408685:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779467264 00000100:00100000:1.0:1789061426.408818:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789061426.408830:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:5848:x1875966779467264:12345-0@lo:101: 00010000:00010000:1.0:1789061426.408852:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061426.408893:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a5b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a5b0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.408924:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a5b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a5b0 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.408938:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a5b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a5b0 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.408947:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4cc84c00, rc 0) 00000100:00100000:1.0:1789061426.409045:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779467264:12345-0@lo:101: Request processed in 205us (4159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061426.409052:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789061426.409109:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779467264:0@lo:101: 00010000:00010000:1.0:1789061426.409128:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a5b7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.409138:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a5b7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061426.409197:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779467392:0@lo:256: 00000100:00100000:1.0:1789061426.409235:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.409265:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a79f48600 going to sleep for 11 seconds 00000100:00100000:1.0:1789061426.409280:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779467392 00000100:00100000:1.0:1789061426.409284:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779467392 00000100:00100000:1.0:1789061426.409306:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789061426.409313:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779467392:12345-0@lo:256: 20000000:01000000:1.0:1789061426.409327:0:5843:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789061426.409343:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789061426.410653:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789061426.410778:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779467392:12345-0@lo:256: Request processed in 1463us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061426.410788:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789061426.410886:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779467392:0@lo:256: 10000000:01000000:2.0:1789061426.410937:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789061426.410946:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a5b7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061426.410956:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a5b7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061426.410965:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789061426.410968:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789061426.410971:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789061426.411001:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061426.411009:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061426.411017:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061426.411044:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76195500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779467520:0@lo:101: 00000100:00100000:2.0:1789061426.411073:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061426.411106:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a460f2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061426.411156:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779467520 00000100:00100000:1.0:1789061426.411161:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779467520 00000100:00100000:1.0:1789061426.411197:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789061426.411204:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779467520:12345-0@lo:101: 00010000:00010000:1.0:1789061426.411214:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061426.411225:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4cc84000/0x427fa11dc4a9a5c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a5be expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.411243:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4cc84000/0x427fa11dc4a9a5c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a5be expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.411253:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4cc84000/0x427fa11dc4a9a5c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a5be expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.411260:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4cc84000, rc 0) 00000100:00100000:1.0:1789061426.411299:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779467520:12345-0@lo:101: Request processed in 96us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061426.411305:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789061426.411524:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76195500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779467520:0@lo:101: 00010000:00010000:3.0:1789061426.411536:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a5c5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061426.411554:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a5c5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061426.411601:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779467648:0@lo:501: 00000100:00100000:3.0:1789061426.411626:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061426.411645:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061426.412595:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779467648 00000100:00100000:2.0:1789061426.412604:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779467648 00000100:00100000:2.0:1789061426.412636:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789061426.412644:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779467648:12345-0@lo:501: 00000100:00100000:2.0:1789061426.412844:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779467648:12345-0@lo:501: Request processed in 200us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061426.412852:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779467648:0@lo:501: 00000100:00100000:2.0:1789061426.412852:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789061426.412885:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779467776:0@lo:503: 00000100:00100000:3.0:1789061426.412925:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061426.412955:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061426.413141:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779467776 00000100:00100000:2.0:1789061426.413146:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779467776 00000100:00100000:2.0:1789061426.413169:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789061426.413174:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779467776:12345-0@lo:503: 00000100:00100000:1.0:1789061426.417974:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779467776:12345-0@lo:503: Request processed in 4790us (5040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061426.417988:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789061426.421662:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779467776:0@lo:503: 00000100:00100000:1.0:1789061426.422802:0:6727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:6727:1875966779467904:0@lo:502: 00000100:00100000:1.0:1789061426.422885:0:6727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.422931:0:6727:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64d22240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061426.423519:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779467904 00000100:00100000:0.0:1789061426.423529:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779467904 00000100:00100000:0.0:1789061426.423577:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789061426.423587:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+15:6727:x1875966779467904:12345-0@lo:502: 00000100:00100000:0.0:1789061426.423880:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+15:6727:x1875966779467904:12345-0@lo:502: Request processed in 294us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061426.423889:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789061426.425733:0:6727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:6727:1875966779467904:0@lo:502: 00000020:01000000:1.0:1789061426.425782:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789061426.425791:0:6727:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789061426.425799:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061426.425802:0:6727:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789061426.425806:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789061426.425810:0:6727:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:1.0:1789061426.425834:0:6727:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789061426.425837:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789061426.425851:0:6727:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff971a7c733380) 00000020:00000080:1.0:1789061426.425871:0:6727:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789061426.425876:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789061426.425959:0:6727:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789061426.425965:0:6727:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789061426.425972:0:6727:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9a5d3 00010000:00080000:1.0:1789061426.426003:0:6727:0:(ldlm_lib.c:102:import_set_conn()) imp ffff971944fff000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1789061426.426253:0:6727:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789061426.503623:0:6727:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789061426.503647:0:6727:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789061426.504268:0:6727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061426.504653:0:6727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061426.504718:0:6727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789061426.504780:0:6727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789061426.506621:0:6730:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789061426.506629:0:6730:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789061426.508840:0:6727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789061426.508856:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789061426.508893:0:6727:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789061426.508915:0:6727:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x427fa11dc4a9a5da 00000100:00080000:1.0:1789061426.508926:0:6727:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789061426.508938:0:6727:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff971944fff000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789061426.508978:0:6727:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971a7613c700 x1875966779468032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789061426.509004:0:6727:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789061426.509067:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061426.509071:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061426.509073:0:6727:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789061426.509076:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061426.509086:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061426.509088:0:6727:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789061426.509092:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789061426.509094:0:6727:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789061426.509122:0:6727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:6727:1875966779468160:0@lo:502: 00000100:00100000:1.0:1789061426.509199:0:6727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.509240:0:6727:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a460f0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789061426.509271:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779468160 00000100:00100000:1.0:1789061426.509277:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779468160 00000100:00100000:1.0:1789061426.509309:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789061426.509317:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+15:6727:x1875966779468160:12345-0@lo:502: 00000100:00100000:2.0:1789061426.510646:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779468032:0@lo:8: 00000100:00100000:2.0:1789061426.510701:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.510744:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+15:6727:x1875966779468160:12345-0@lo:502: Request processed in 1426us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061426.510753:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789061426.510756:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779468032 00000100:00100000:2.0:1789061426.510761:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779468032 00000100:00100000:2.0:1789061426.510783:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789061426.510789:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1875966779468032:12345-0@lo:8: 00010000:00080000:2.0:1789061426.510810:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000100:00100000:1.0:1789061426.510812:0:6727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:6727:1875966779468160:0@lo:502: 00000020:00000080:2.0:1789061426.510835:0:6699:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x427fa11dc4a9a5e1 00000020:01000000:1.0:1789061426.510837:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061426.510841:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061426.510843:0:6727:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789061426.510847:0:6727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00002000:00100000:2.0:1789061426.510868:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff971944d9e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789061426.510872:0:6699:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789061426.510876:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:1.0:1789061426.510952:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789061426.510971:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789061426.510981:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a5c5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1789061426.510982:0:6699:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:1.0:1789061426.510992:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a5c5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061426.511002:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789061426.511004:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff971a47d64d40 from 1 10000000:01000000:1.0:1789061426.511014:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789061426.511052:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.511061:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.511070:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061426.511083:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779468288:0@lo:101: 00000100:00100000:1.0:1789061426.511110:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.511126:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a460f0300 going to sleep for 11 seconds 00002000:00080000:2.0:1789061426.511137:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1789061426.511141:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779468288 00000100:00100000:1.0:1789061426.511144:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779468288 00000100:00080000:2.0:1789061426.511160:0:6699:0:(import.c:65:import_set_state_nolock()) ffff971944d9a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061426.511164:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789061426.511170:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779468288:12345-0@lo:101: 00010000:00010000:1.0:1789061426.511178:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061426.511189:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a5ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a5e8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061426.511198:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875966779468032:12345-0@lo:8: Request processed in 409us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061426.511204:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789061426.511211:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a5ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a5e8 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.511221:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a5ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a5e8 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.511230:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4cc85800, rc 0) 00010000:00080000:2.0:1789061426.511240:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7613c700 x1875966779468032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789061436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061426.511250:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1789061426.511254:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779468288:12345-0@lo:101: Request processed in 86us (144us total) trans 0 rc 0/0 00000100:00080000:2.0:1789061426.511256:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789061426.511264:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:1.0:1789061426.511268:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789061426.511269:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789061426.511271:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971944fff000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789061426.511280:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789061426.511284:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779468032:0@lo:8: 00000100:00100000:1.0:1789061426.511295:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779468288:0@lo:101: 00000004:00080000:2.0:1789061426.511302:0:6730:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:1.0:1789061426.511307:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a5ef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.511316:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a5ef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061426.511352:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779468416:0@lo:501: 00000100:00100000:1.0:1789061426.511373:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.511385:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a460f0300 going to sleep for 11 seconds 00000004:00080000:2.0:1789061426.511391:0:6730:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 200752902912ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789061426.511398:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779468416 00000100:00100000:1.0:1789061426.511401:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779468416 00000100:00100000:1.0:1789061426.511669:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789061426.511677:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779468416:12345-0@lo:501: 00000100:00100000:1.0:1789061426.512604:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779468416:12345-0@lo:501: Request processed in 923us (1224us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789061426.512615:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789061426.512675:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779468416:0@lo:501: 10000000:01000000:1.0:1789061426.512703:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789061426.512710:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a5ef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061426.512719:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a5ef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789061426.565732:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1789061426.594578:0:6731:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789061426.594607:0:6731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6731:1875966779468672:0@lo:7: 00000100:00100000:0.0:1789061426.594683:0:6731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061426.594728:0:6731:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ceff180 going to sleep for 11 seconds 00000100:00100000:1.0:1789061426.594807:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779468544:0@lo:13: 00000100:00100000:1.0:1789061426.594851:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061426.594936:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779468544 00000100:00100000:0.0:1789061426.594945:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779468544 00000100:00100000:0.0:1789061426.595016:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789061426.595026:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875966779468544:12345-0@lo:13: 00002000:00000024:0.0:1789061426.595059:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:0.0:1789061426.595112:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875966779468544:12345-0@lo:13: Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061426.595119:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789061426.595281:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061426.595313:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7c2b7b80 x1875966779468544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061426.595331:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779468544:0@lo:13: 00000100:00100000:0.0:1789061426.595591:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779468672 00000100:00100000:0.0:1789061426.595597:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779468672 00000100:00100000:0.0:1789061426.595840:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789061426.595850:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6731:x1875966779468672:12345-0@lo:7: 00002000:00080000:0.0:1789061426.604212:0:6702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789061426.604220:0:6702:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789061426.604380:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6731:x1875966779468672:12345-0@lo:7: Request processed in 8528us (9693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061426.604391:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789061426.604642:0:6731:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7c2b5500 x1875966779468672/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789061442 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061426.604660:0:6731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6731:1875966779468672:0@lo:7: 00000004:00080000:1.0:1789061426.604675:0:6731:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789061426.604800:0:6731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6731:1875966779468800:0@lo:5: 00000100:00100000:0.0:1789061426.604845:0:6731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061426.604890:0:6731:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ceff480 going to sleep for 11 seconds 00000100:00100000:2.0:1789061426.607070:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779468800 00000100:00100000:2.0:1789061426.607087:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779468800 00000100:00100000:2.0:1789061426.608324:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061426.608341:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6731:x1875966779468800:12345-0@lo:5: 00002000:00080000:2.0:1789061426.608378:0:6701:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789061426.608382:0:6701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789061426.608861:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6731:x1875966779468800:12345-0@lo:5: Request processed in 525us (4013us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789061426.608869:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789061426.611671:0:6731:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7c2b6a00 x1875966779468800/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789061442 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061426.611693:0:6731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6731:1875966779468800:0@lo:5: 00000004:00080000:0.0:1789061426.611709:0:6731:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789061426.611754:0:6731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6731:1875966779468928:0@lo:700: 00000100:00100000:0.0:1789061426.611824:0:6731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061426.611876:0:6731:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ceff480 going to sleep for 11 seconds 00000100:00100000:1.0:1789061426.611948:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779468928 00000100:00100000:1.0:1789061426.611955:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779468928 00000100:00100000:1.0:1789061426.612023:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061426.612043:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6731:x1875966779468928:12345-0@lo:700: 00000100:00100000:1.0:1789061426.612094:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6708:1875966779469056:0@lo:700: 00000100:00100000:1.0:1789061426.612129:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061426.612155:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fea6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061426.612178:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779469056 00000100:00100000:1.0:1789061426.612182:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779469056 00000100:00100000:1.0:1789061426.612222:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061426.612230:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6708:x1875966779469056:12345-0@lo:700: 00000100:00080000:1.0:1789061426.613754:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:1.0:1789061426.697785:0:5858:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1789061426.708826:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6708:x1875966779469056:12345-0@lo:700: Request processed in 96588us (96687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061426.708843:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789061426.708882:0:6708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7613c380 x1875966779469056/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789061442 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061426.708899:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6708:1875966779469056:0@lo:700: 40000000:02000000:0.0:1789061426.708915:0:6708:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1789061426.789162:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789061426.789250:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789061426.789882:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6731:x1875966779468928:12345-0@lo:700: Request processed in 177837us (178053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061426.789899:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789061426.790059:0:6731:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7c2b4a80 x1875966779468928/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789061442 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061426.790070:0:6731:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789061426.790163:0:6731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6731:1875966779468928:0@lo:700: 00000004:02000040:2.0:1789061426.814897:0:6731:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789061426.819055:0:6731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6731:1875966779469184:0@lo:5: 00000100:00100000:3.0:1789061426.819123:0:6731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061426.819220:0:6731:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061426.819264:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779469184 00000100:00100000:0.0:1789061426.819271:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779469184 00000100:00100000:0.0:1789061426.819316:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789061426.819324:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6731:x1875966779469184:12345-0@lo:5: 00002000:00080000:1.0:1789061426.829813:0:6702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789061426.829847:0:6702:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789061426.832904:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6731:x1875966779469184:12345-0@lo:5: Request processed in 13573us (13772us total) trans 4294967298 rc 0/0 00010000:00080000:3.0:1789061426.832987:0:6731:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a47c2ad80 x1875966779469184/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789061442 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061426.833013:0:6731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6731:1875966779469184:0@lo:5: 00000004:00080000:3.0:1789061426.833038:0:6731:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000100:00100000:1.0:1789061426.833200:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789061427.070692:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061428.098289:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061429.117662:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061430.143248:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061431.166179:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061431.552576:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779469696:0@lo:400: 00000100:00100000:3.0:1789061431.552646:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061431.552711:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061431.552718:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779469312:0@lo:400: 00000100:00100000:3.0:1789061431.552748:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061431.552784:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779469440:0@lo:400: 00000100:00100000:3.0:1789061431.552809:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061431.552828:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061431.552833:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779469568:0@lo:400: 00000100:00100000:3.0:1789061431.552856:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061431.552900:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779469696 00000100:00100000:3.0:1789061431.552908:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779469696 00000100:00100000:3.0:1789061431.552978:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789061431.552987:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875966779469696:12345-0@lo:400: 00000100:00100000:3.0:1789061431.553039:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875966779469696:12345-0@lo:400: Request processed in 53us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061431.553046:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789061431.553070:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779469312 00000100:00100000:3.0:1789061431.553073:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779469312 00000100:00100000:3.0:1789061431.553095:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789061431.553101:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+16:3312:x1875966779469312:12345-0@lo:400: 00000100:00100000:3.0:1789061431.553130:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+16:3312:x1875966779469312:12345-0@lo:400: Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061431.553136:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789061431.553165:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779469440 00000100:00100000:3.0:1789061431.553169:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779469440 00000100:00100000:3.0:1789061431.553192:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779469568 00000100:00100000:3.0:1789061431.553195:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779469568 00000100:00100000:3.0:1789061431.553212:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061431.553217:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779469440:12345-0@lo:400: 00000100:00100000:3.0:1789061431.553258:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779469440:12345-0@lo:400: Request processed in 40us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061431.553264:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061431.553278:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789061431.553283:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779469568:12345-0@lo:400: 00000100:00100000:3.0:1789061431.553308:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779469568:12345-0@lo:400: Request processed in 25us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061431.553314:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789061431.553333:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061431.553337:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789061431.553368:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a47c2b100 x1875966779469568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061431.553380:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779469568:0@lo:400: 00010000:00080000:3.0:1789061431.553389:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a47c2b800 x1875966779469440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061431.553396:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779469440:0@lo:400: 00000100:00100000:3.0:1789061431.553419:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779469312:0@lo:400: 00010000:00080000:3.0:1789061431.553429:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a47c29180 x1875966779469696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061431.553436:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779469696:0@lo:400: 00000100:00100000:3.0:1789061432.067349:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061432.067379:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779469824:0@lo:13: 00000100:00100000:3.0:1789061432.067450:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061432.067542:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779469824 00000100:00100000:3.0:1789061432.067554:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779469824 00000100:00100000:3.0:1789061432.067609:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061432.067619:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875966779469824:12345-0@lo:13: 00002000:00000024:3.0:1789061432.067655:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061432.072780:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875966779469824:12345-0@lo:13: Request processed in 5152us (5319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061432.072801:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789061432.073297:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a76196a00 x1875966779469824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061432.073324:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779469824:0@lo:13: 00000001:00080000:2.0:1789061432.189435:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789061432.192156:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789061432.921122:0:7069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789061433.213898:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061434.238003:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061435.262426:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061436.285893:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061436.670111:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779470208:0@lo:400: 00000100:00100000:3.0:1789061436.670235:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779469952:0@lo:400: 00000100:00100000:3.0:1789061436.670307:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061436.670371:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061436.670377:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779470080:0@lo:400: 00000100:00100000:3.0:1789061436.670403:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061436.670441:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779469952 00000100:00100000:3.0:1789061436.670452:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779469952 00000100:00100000:3.0:1789061436.670601:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789061436.670611:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:3310:x1875966779469952:12345-0@lo:400: 00000100:00100000:3.0:1789061436.670671:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:3310:x1875966779469952:12345-0@lo:400: Request processed in 62us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061436.670679:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789061436.670712:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779470080 00000100:00100000:3.0:1789061436.670716:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779470080 00000100:00100000:3.0:1789061436.670743:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789061436.670749:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779470080:12345-0@lo:400: 00000100:00100000:3.0:1789061436.670791:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779470080:12345-0@lo:400: Request processed in 43us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061436.670800:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789061436.670858:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7c2b4a80 x1875966779470080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061436.670875:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779470080:0@lo:400: 00000100:00100000:3.0:1789061436.670886:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779469952:0@lo:400: 00000100:00100000:0.0:1789061436.671036:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061436.671065:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789061436.671074:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779470336:0@lo:400: 00000100:00100000:0.0:1789061436.671104:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061436.671246:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779470336 00000100:00100000:1.0:1789061436.671251:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779470336 00000100:00100000:1.0:1789061436.671307:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789061436.671316:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779470336:12345-0@lo:400: 00000100:00100000:1.0:1789061436.671360:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779470336:12345-0@lo:400: Request processed in 48us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061436.671367:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789061436.671425:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789061436.671449:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7c2b5500 x1875966779470336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061436.671458:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789061436.671470:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779470336:0@lo:400: 00000100:00100000:3.0:1789061436.671802:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779470208 00000100:00100000:3.0:1789061436.671809:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779470208 00000100:00100000:3.0:1789061436.671901:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789061436.671908:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779470208:12345-0@lo:400: 00000100:00100000:3.0:1789061436.671949:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779470208:12345-0@lo:400: Request processed in 42us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061436.671955:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789061436.672041:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7c2b6a00 x1875966779470208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061436.672064:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779470208:0@lo:400: 00000100:00080000:1.0:1789061436.675070:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061437.183034:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779470464:0@lo:13: 00000100:00100000:1.0:1789061437.183126:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061437.184325:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779470464 00000100:00100000:2.0:1789061437.184343:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779470464 00000100:00100000:2.0:1789061437.184410:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061437.184422:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779470464:12345-0@lo:13: 00002000:00000024:2.0:1789061437.184471:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061437.187422:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779470464:12345-0@lo:13: Request processed in 2987us (4280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061437.187443:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789061437.187717:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7613f480 x1875966779470464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061437.187749:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779470464:0@lo:13: 00010000:00010000:1.0:1789061437.310568:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061438.335218:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061439.357880:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061440.382036:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061441.407535:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061441.790355:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779470720:0@lo:400: 00000100:00100000:0.0:1789061441.790453:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061441.790553:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789061441.790560:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779470848:0@lo:400: 00000100:00100000:0.0:1789061441.790584:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061441.790712:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779470592:0@lo:400: 00000100:00100000:1.0:1789061441.790763:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061441.790791:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061441.790797:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779470976:0@lo:400: 00000100:00100000:1.0:1789061441.790822:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061441.790878:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779470592 00000100:00100000:1.0:1789061441.790888:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779470592 00000100:00100000:1.0:1789061441.790948:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789061441.790958:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+16:3311:x1875966779470592:12345-0@lo:400: 00000100:00100000:1.0:1789061441.791015:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+16:3311:x1875966779470592:12345-0@lo:400: Request processed in 59us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061441.791023:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789061441.791073:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779470976 00000100:00100000:1.0:1789061441.791077:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779470976 00000100:00100000:1.0:1789061441.791114:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789061441.791120:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779470976:12345-0@lo:400: 00000100:00100000:1.0:1789061441.791151:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779470976:12345-0@lo:400: Request processed in 31us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061441.791156:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789061441.791175:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061441.791211:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7c2b4700 x1875966779470976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061441.791227:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779470976:0@lo:400: 00000100:00100000:1.0:1789061441.791235:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779470592:0@lo:400: 00000100:00100000:2.0:1789061441.791532:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779470720 00000100:00100000:2.0:1789061441.791538:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779470720 00000100:00100000:2.0:1789061441.791617:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779470848 00000100:00100000:2.0:1789061441.791621:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779470848 00000100:00080000:1.0:1789061441.791681:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061441.794504:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061441.794535:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779470720:12345-0@lo:400: 00000100:00100000:0.0:1789061441.794674:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779470720:12345-0@lo:400: Request processed in 155us (4220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061441.794681:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061441.794716:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789061441.794725:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779470848:12345-0@lo:400: 00000100:00100000:0.0:1789061441.794779:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779470848:12345-0@lo:400: Request processed in 55us (4193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061441.794785:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789061441.794842:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7c2b6680 x1875966779470848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061441.794861:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779470848:0@lo:400: 00010000:00080000:0.0:1789061441.794875:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7c2b5500 x1875966779470720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061441.794882:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779470720:0@lo:400: 00000100:00100000:1.0:1789061442.305691:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779471104:0@lo:13: 00000100:00100000:1.0:1789061442.307034:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061442.307832:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779471104 00000100:00100000:3.0:1789061442.308340:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779471104 00000100:00100000:3.0:1789061442.308442:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061442.308462:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779471104:12345-0@lo:13: 00002000:00000024:3.0:1789061442.308565:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061442.308680:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779471104:12345-0@lo:13: Request processed in 228us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061442.308689:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789061442.308927:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7c2b5500 x1875966779471104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061442.308955:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779471104:0@lo:13: 00010000:00010000:2.0:1789061442.429984:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061443.456151:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061444.477824:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061445.502883:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789061446.467698:0:7643:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789061446.467702:0:7643:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789061446.467838:0:7643:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff971a75aff800 00000020:01000004:2.0:1789061446.467852:0:7643:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789061446.467863:0:7643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789061446.467882:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff971a7cbb0000) 00000020:00000080:2.0:1789061446.467898:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789061446.522626:0:7643:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789061446.522895:0:7643:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:3.0:1789061446.526113:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789061446.554949:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789061446.561358:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789061446.561402:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789061446.562471:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789061446.562539:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789061446.562926:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789061446.562938:0:7643:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789061446.562949:0:7643:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x427fa11dc4a9a5fd 00000020:01000004:3.0:1789061446.562958:0:7643:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789061446.563003:0:7643:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789061446.563006:0:7643:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789061446.563011:0:7643:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789061446.563050:0:7643:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789061446.563054:0:7643:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789061446.588325:0:7643:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789061446.588394:0:7643:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789061446.588398:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789061446.588401:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789061446.588402:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789061446.588404:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789061446.588405:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789061446.588407:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789061446.588408:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789061446.588409:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789061446.588410:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789061446.588412:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789061446.588413:0:7643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789061446.588417:0:7643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789061446.588420:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789061446.588421:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789061446.588422:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789061446.588423:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789061446.588424:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789061446.588430:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789061446.588431:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789061446.588432:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789061446.588433:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789061446.588434:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789061446.588434:0:7643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789061446.588660:0:7643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789061446.588789:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779471232:0@lo:253: 00000100:00100000:2.0:1789061446.588865:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061446.588954:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4f4d0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789061446.589112:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779471232 00000100:00100000:3.0:1789061446.589120:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779471232 00000100:00100000:3.0:1789061446.589216:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789061446.589226:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+16:7643:x1875966779471232:12345-0@lo:253: 20000000:01000000:3.0:1789061446.589265:0:5843:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789061446.589269:0:5843:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789061446.589274:0:5843:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789061446.589277:0:5843:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789061446.590475:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789061446.591388:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789061446.591406:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789061446.591455:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789061446.591698:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789061446.591737:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789061446.591790:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789061446.596403:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789061446.596445:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:2.0:1789061446.596448:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:2.0:1789061446.596531:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789061446.596539:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789061446.596615:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789061446.596624:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:2.0:1789061446.596674:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789061446.596685:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789061446.596719:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789061446.596792:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789061446.598930:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1789061446.599183:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:2.0:1789061446.599187:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:2.0:1789061446.599241:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1789061446.599251:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789061446.599285:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1789061446.599293:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:2.0:1789061446.599325:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1789061446.599334:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789061446.599388:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1789061446.599429:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1789061446.599451:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1789061446.599455:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1789061446.601416:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789061446.601421:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789061446.601423:0:5843:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789061446.601448:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789061446.601452:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789061446.602686:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789061446.602694:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789061446.611987:0:7644:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789061446.612279:0:7644:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789061446.612343:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789061446.617112:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789061446.617173:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789061446.617251:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789061446.617267:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789061446.617270:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789061446.620673:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789061446.621050:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789061446.621096:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789061446.621165:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789061446.621179:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789061446.621181:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789061446.622529:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1789061446.622608:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1789061446.622680:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789061446.623111:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789061446.623167:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789061446.623205:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789061446.623217:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789061446.623219:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789061446.623949:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1789061446.624839:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1789061446.624878:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789061446.625483:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789061446.627135:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789061446.627216:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1789061446.627240:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789061446.627262:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.627281:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a54e expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.627290:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a57f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a578 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.627297:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a5a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a5a2 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.627304:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a4cc84000/0x427fa11dc4a9a5c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a5be expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.627311:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a5ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a5e8 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.627317:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.627378:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a5ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a5e8 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.627394:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a5ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5e8 expref: 16 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061446.627409:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875966779471360:0@lo:104: 00000100:00100000:0.0:1789061446.627515:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061446.627564:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a4cc84000/0x427fa11dc4a9a5c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a5be expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.627572:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a4cc84000/0x427fa11dc4a9a5c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5be expref: 16 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061446.627580:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875966779471488:0@lo:104: 00010000:00010000:0.0:1789061446.627621:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a5a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a5a2 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.627628:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a5a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5a2 expref: 16 pid: 5845 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061446.627635:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875966779471616:0@lo:104: 00010000:00010000:0.0:1789061446.627671:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a578 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.627679:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a57f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a578 expref: 16 pid: 5843 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061446.627687:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875966779471744:0@lo:104: 00010000:00010000:0.0:1789061446.627716:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a54e expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.627724:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a54e expref: 16 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061446.627731:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875966779471872:0@lo:104: 00000100:00100000:0.0:1789061446.627745:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4626e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061446.628007:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789061446.628027:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.628055:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.628063:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.628071:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.628082:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779471360 00000100:00100000:1.0:1789061446.628088:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779471360 00000100:00100000:1.0:1789061446.628121:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779471488 00000100:00100000:1.0:1789061446.628124:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779471488 00000100:00100000:1.0:1789061446.628132:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779471616 00000100:00100000:1.0:1789061446.628134:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779471616 00000100:00100000:1.0:1789061446.628141:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779471744 00000100:00100000:1.0:1789061446.628143:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779471744 00000100:00100000:1.0:1789061446.628149:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779471872 00000100:00100000:1.0:1789061446.628152:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779471872 00000100:00100000:1.0:1789061446.628163:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789061446.628170:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4d715050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+7:5843:x1875966779471360:12345-0@lo:104: 00010000:00010000:1.0:1789061446.628183:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a5ef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628232:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789061446.628238:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4d715050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+7:5843:x1875966779471360:12345-0@lo:104: Request processed in 68us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.628244:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789061446.628281:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789061446.628288:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+6:5843:x1875966779471488:12345-0@lo:104: 00010000:00010000:1.0:1789061446.628296:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a5c5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628338:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789061446.628343:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+6:5843:x1875966779471488:12345-0@lo:104: Request processed in 56us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.628349:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789061446.628361:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789061446.628367:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+5:5843:x1875966779471616:12345-0@lo:104: 00010000:00010000:1.0:1789061446.628373:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a5a9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628398:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789061446.628403:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+5:5843:x1875966779471616:12345-0@lo:104: Request processed in 38us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.628408:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789061446.628420:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789061446.628426:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+4:5843:x1875966779471744:12345-0@lo:104: 00010000:00010000:1.0:1789061446.628432:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a57f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628458:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789061446.628463:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+4:5843:x1875966779471744:12345-0@lo:104: Request processed in 38us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.628468:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789061446.628479:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789061446.628484:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+3:5843:x1875966779471872:12345-0@lo:104: 00010000:00010000:1.0:1789061446.628517:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a555 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628553:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789061446.628558:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+3:5843:x1875966779471872:12345-0@lo:104: Request processed in 74us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.628564:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789061446.628582:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789061446.628599:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a5ef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628607:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc85c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061446.628611:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a5ef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628619:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a5ef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061446.628627:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a5ef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061446.628633:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789061446.628674:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a5ef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628680:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061446.628694:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a5ef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628701:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a5e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a5ef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628726:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789061446.628729:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a5c5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628734:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042600 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061446.628737:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a5c5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628744:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a5c5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061446.628750:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a5c5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061446.628755:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789061446.628768:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a5c5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628773:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061446.628779:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a5c5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628785:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a82042600/0x427fa11dc4a9a5be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a5c5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628795:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789061446.628798:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a5a9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628813:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042e00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061446.628816:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a5a9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628823:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a5a9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061446.628829:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a5a9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061446.628834:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789061446.628846:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a5a9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628851:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061446.628865:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a5a9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628871:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9a5a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a5a9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628880:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789061446.628883:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a57f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628888:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41477400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061446.628890:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a57f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628906:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a57f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061446.628913:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a57f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061446.628917:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789061446.628930:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a57f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628936:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061446.628941:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a57f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628947:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a41477400/0x427fa11dc4a9a578 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a57f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628956:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061446.628959:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a555 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628965:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042800 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061446.628968:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a555 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.628974:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a555 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061446.628979:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a555 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061446.628989:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789061446.629016:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a555 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.629022:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061446.629027:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a555 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.629033:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a82042800/0x427fa11dc4a9a54e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a555 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.629046:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061446.629048:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061446.629050:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061446.629062:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779472256:0@lo:103: 00000100:00100000:1.0:1789061446.629093:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.629124:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061446.629130:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779472384:0@lo:103: 00000100:00100000:1.0:1789061446.629148:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.629179:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779472256 00000100:00100000:1.0:1789061446.629183:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779472256 00010000:00010000:1.0:1789061446.629201:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a5a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5a2 expref: 17 pid: 5845 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061446.629221:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779472384 00000100:00100000:1.0:1789061446.629224:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779472384 00010000:00010000:1.0:1789061446.629235:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a57f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a578 expref: 18 pid: 5843 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061446.629261:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789061446.629268:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+18:3310:x1875966779472256:12345-0@lo:103: 00010000:00010000:1.0:1789061446.629279:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061446.629284:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a5a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5a2 expref: 18 pid: 5845 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.629293:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a5a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5a2 expref: 18 pid: 5845 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.629307:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061446.629337:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+18:3310:x1875966779472256:12345-0@lo:103: Request processed in 70us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.629343:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789061446.629356:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789061446.629361:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+17:3310:x1875966779472384:12345-0@lo:103: 00010000:00010000:1.0:1789061446.629368:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061446.629372:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a57f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a578 expref: 17 pid: 5843 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.629380:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a57f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a578 expref: 17 pid: 5843 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.629389:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061446.629409:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+17:3310:x1875966779472384:12345-0@lo:103: Request processed in 49us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.629414:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789061446.629448:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779472384:0@lo:103: 00000100:00100000:1.0:1789061446.629463:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779472256:0@lo:103: 00010000:00010000:0.0:1789061446.631727:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061446.631758:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779472000:0@lo:103: 00000100:00100000:0.0:1789061446.631827:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.631874:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779472512:0@lo:103: 00000100:00100000:0.0:1789061446.631897:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.631933:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789061446.631939:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779472128:0@lo:103: 00000100:00100000:0.0:1789061446.631974:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.632165:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875966779471360:0@lo:104: 00000100:00100000:0.0:1789061446.632176:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875966779471488:0@lo:104: 00010000:00010000:0.0:1789061446.632187:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41476000/0x427fa11dc4a9a5a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a5a2 expref: 16 pid: 5845 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061446.632203:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875966779471616:0@lo:104: 00010000:00010000:0.0:1789061446.632212:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a57f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a578 expref: 15 pid: 5843 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061446.632222:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875966779471744:0@lo:104: 00000100:00100000:0.0:1789061446.632231:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875966779471872:0@lo:104: 00010000:00010000:0.0:1789061446.632276:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061446.633981:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779472000 00000100:00100000:3.0:1789061446.634186:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779472512 00000100:00100000:3.0:1789061446.634199:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779472512 00010000:00010000:3.0:1789061446.634234:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a54e expref: 15 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061446.634257:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779472128 00000100:00100000:3.0:1789061446.634260:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779472128 00010000:00010000:3.0:1789061446.634271:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a4cc84000/0x427fa11dc4a9a5c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5be expref: 16 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061446.634283:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789061446.634291:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+16:3312:x1875966779472512:12345-0@lo:103: 00010000:00010000:3.0:1789061446.634306:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061446.634311:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a54e expref: 16 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634321:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a54e expref: 16 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634350:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a40031400/0x427fa11dc4a9a555 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a54e expref: 16 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634366:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061446.634431:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+15:3312:x1875966779472512:12345-0@lo:103: Request processed in 140us (2533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061446.634436:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789061446.634452:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789061446.634541:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779472000 00010000:00010000:2.0:1789061446.634561:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a5ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5e8 expref: 15 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061446.634575:0:5836:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789061446.634583:0:5836:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789061446.634632:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+15:3312:x1875966779472128:12345-0@lo:103: 00010000:00010000:3.0:1789061446.634642:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061446.634659:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a4cc84000/0x427fa11dc4a9a5c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5be expref: 15 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634668:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a4cc84000/0x427fa11dc4a9a5c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5be expref: 15 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634677:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4cc84000/0x427fa11dc4a9a5c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a5be expref: 15 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634686:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061446.634711:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+14:3312:x1875966779472128:12345-0@lo:103: Request processed in 254us (2737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061446.634717:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789061446.634731:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789061446.634737:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+13:3312:x1875966779472000:12345-0@lo:103: 00010000:00010000:3.0:1789061446.634744:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061446.634749:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a5ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5e8 expref: 13 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634763:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a5ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5e8 expref: 13 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634772:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a5ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a5e8 expref: 13 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634784:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634792:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634804:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634810:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634816:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634822:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634827:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40031800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061446.634830:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634837:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634870:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.634879:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061446.634901:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+12:3312:x1875966779472000:12345-0@lo:103: Request processed in 164us (3073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061446.634906:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789061446.634944:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779472128:0@lo:103: 00000100:00100000:3.0:1789061446.634954:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779472000:0@lo:103: 00010000:00010000:2.0:1789061446.635102:0:5843:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061446.635111:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061446.635123:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a40031800/0x427fa11dc4a9a604 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789061446.635137:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789061446.635184:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779472512:0@lo:103: 00000100:00100000:3.0:1789061446.710344:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+11:7643:x1875966779471232:12345-0@lo:253: Request processed in 121109us (121468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061446.710362:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789061446.710616:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779471232:0@lo:253: 10000000:01000000:0.0:1789061446.710631:0:7643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789061446.710634:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789061446.710636:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789061446.710638:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061446.710639:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789061446.710641:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061446.710642:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061446.710654:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789061446.710656:0:7643:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789061446.710658:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061446.710659:0:7643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789061446.710680:0:7643:0:(tgt_mount.c:101:server_register_mount()) register mount ffff971a75aff800 from lustre-OST0001 10000000:01000000:0.0:1789061446.710707:0:7643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789061446.710710:0:7643:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789061446.710716:0:7643:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff971a47d64d40 local copy 10000000:01000000:0.0:1789061446.710721:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789061446.710757:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.710768:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.710778:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061446.710795:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779472640:0@lo:101: 00000100:00100000:0.0:1789061446.710830:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.710884:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4626e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061446.711056:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779472640 00000100:00100000:3.0:1789061446.711062:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779472640 00000100:00100000:3.0:1789061446.711105:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789061446.711115:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+11:7643:x1875966779472640:12345-0@lo:101: 00010000:00010000:3.0:1789061446.711127:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061446.711141:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a41476400/0x427fa11dc4a9a612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a60b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.711165:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41476400/0x427fa11dc4a9a612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a60b expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.711175:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a41476400/0x427fa11dc4a9a612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a60b expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061446.711194:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476400, rc 0) 00000100:00100000:3.0:1789061446.711240:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:7643:x1875966779472640:12345-0@lo:101: Request processed in 115us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061446.711247:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789061446.711663:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779472640:0@lo:101: 00010000:00010000:0.0:1789061446.711680:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x427fa11dc4a9a612 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.711689:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x427fa11dc4a9a612 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061446.711783:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779472768:0@lo:501: 00000100:00100000:0.0:1789061446.711812:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.711842:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4626e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061446.711898:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779472768 00000100:00100000:3.0:1789061446.711903:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779472768 00000100:00100000:3.0:1789061446.711935:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789061446.711942:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:7643:x1875966779472768:12345-0@lo:501: 00000100:00100000:3.0:1789061446.712372:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:7643:x1875966779472768:12345-0@lo:501: Request processed in 430us (558us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789061446.712379:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789061446.712936:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779472768:0@lo:501: 10000000:01000000:0.0:1789061446.713032:0:7643:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789061446.713074:0:7643:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789061446.713081:0:7643:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x427fa11dc4a9a612 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.713091:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x427fa11dc4a9a612 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.713098:0:7643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x427fa11dc4a9a612 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.713114:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789061446.713137:0:7643:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff971a75aff800 10000000:01000000:0.0:1789061446.713142:0:7643:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789061446.713148:0:7643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789061446.713150:0:7643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789061446.713154:0:7643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789061446.713166:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789061446.713189:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.713197:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.713205:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061446.713218:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779472896:0@lo:101: 00000100:00100000:0.0:1789061446.713326:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.713418:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4626e480 going to sleep for 11 seconds 00010000:00010000:1.0:1789061446.713515:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061446.713522:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x427fa11dc4a9a612 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.713530:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40031400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061446.713534:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x427fa11dc4a9a612 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.713542:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x427fa11dc4a9a612 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061446.713550:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x427fa11dc4a9a612 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061446.713555:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789061446.713577:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x427fa11dc4a9a612 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.713583:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061446.713614:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x427fa11dc4a9a612 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.713621:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a60b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x427fa11dc4a9a612 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.713638:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061446.713640:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061446.713642:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061446.713759:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061446.713771:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779473024:0@lo:103: 00000100:00100000:3.0:1789061446.713802:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.713973:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779473024 00000100:00100000:1.0:1789061446.713987:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779473024 00000100:00100000:1.0:1789061446.714034:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789061446.714042:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+12:3312:x1875966779473024:12345-0@lo:103: 00010000:00010000:1.0:1789061446.714054:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061446.714067:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41476400/0x427fa11dc4a9a612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a60b expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.714083:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061446.714253:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+11:3312:x1875966779473024:12345-0@lo:103: Request processed in 211us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.714261:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061446.714389:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779473024:0@lo:103: 00000100:00100000:2.0:1789061446.714811:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779472896 00000100:00100000:2.0:1789061446.714817:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779472896 00000100:00100000:2.0:1789061446.714885:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789061446.714893:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+11:7643:x1875966779472896:12345-0@lo:101: 00010000:00010000:2.0:1789061446.714903:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061446.714918:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9a620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a619 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061446.714936:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9a620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a619 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061446.714947:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9a620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a619 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061446.714955:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63ec00, rc 0) 00000100:00100000:2.0:1789061446.715052:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:7643:x1875966779472896:12345-0@lo:101: Request processed in 160us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061446.715058:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789061446.715180:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779472896:0@lo:101: 00010000:00010000:0.0:1789061446.715198:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a620 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.715207:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a620 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061446.715298:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473152:0@lo:501: 00000100:00100000:0.0:1789061446.715328:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.715360:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4626e480 going to sleep for 11 seconds 00000100:00100000:3.0:1789061446.715421:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779473152 00000100:00100000:3.0:1789061446.715426:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779473152 00000100:00100000:3.0:1789061446.715455:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789061446.715607:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:7643:x1875966779473152:12345-0@lo:501: 00000100:00100000:3.0:1789061446.715852:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+12:7643:x1875966779473152:12345-0@lo:501: Request processed in 247us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061446.715902:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473152:0@lo:501: 00000100:00100000:0.0:1789061446.715930:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473280:0@lo:503: 00000100:00100000:0.0:1789061446.715980:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.715995:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4626e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789061446.716159:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779473280 00000100:00100000:2.0:1789061446.716164:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779473280 00000100:00100000:3.0:1789061446.716740:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789061446.716846:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789061446.716855:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:7643:x1875966779473280:12345-0@lo:503: 00000100:00100000:2.0:1789061446.717150:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+12:7643:x1875966779473280:12345-0@lo:503: Request processed in 296us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061446.717167:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789061446.717252:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473280:0@lo:503: 00000040:00080000:0.0:1789061446.717603:0:7643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789061446.717693:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473408:0@lo:502: 00000100:00100000:0.0:1789061446.717731:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.719347:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4626e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789061446.719467:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779473408 00000100:00100000:1.0:1789061446.719475:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779473408 00000100:00100000:1.0:1789061446.719540:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789061446.719549:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:7643:x1875966779473408:12345-0@lo:502: 00000100:00100000:1.0:1789061446.719789:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:7643:x1875966779473408:12345-0@lo:502: Request processed in 240us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.719797:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789061446.719993:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473408:0@lo:502: 00000040:00080000:0.0:1789061446.720266:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789061446.720323:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789061446.720356:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789061446.720407:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789061446.720444:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789061446.720524:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789061446.720559:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473536:0@lo:502: 00000100:00100000:0.0:1789061446.720609:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.720636:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4626e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789061446.721314:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779473536 00000100:00100000:1.0:1789061446.721322:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779473536 00000100:00100000:1.0:1789061446.721354:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789061446.721361:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:7643:x1875966779473536:12345-0@lo:502: 00000100:00100000:1.0:1789061446.721576:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:7643:x1875966779473536:12345-0@lo:502: Request processed in 215us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.721584:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789061446.721799:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473536:0@lo:502: 00000040:00080000:0.0:1789061446.721923:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789061446.721936:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789061446.723417:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789061446.723426:0:7651:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789061446.723432:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061446.723443:0:7651:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789061446.723450:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789061446.723589:0:7651:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff971a7c7319c0) 00000020:00000080:1.0:1789061446.723613:0:7651:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789061446.723621:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789061446.723693:0:7651:0:(tgt_mount.c:153:server_get_mount()) get mount ffff971a75aff800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789061446.723701:0:7651:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789061446.723707:0:7651:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x427fa11dc4a9a62e 00010000:00010000:1.0:1789061446.728899:0:7651:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1789061446.729267:0:7651:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789061446.732103:0:7651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789061446.732428:0:7651:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789061446.745901:0:7651:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789061446.746471:0:7651:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789061446.750821:0:7651:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789061446.750834:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061446.750840:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061446.750842:0:7651:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789061446.750845:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061446.750849:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061446.750850:0:7651:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789061446.750853:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789061446.750855:0:7651:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789061446.750913:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061446.750916:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061446.750918:0:7651:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789061446.750921:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789061446.753150:0:7643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789061446.753188:0:7643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789061446.753205:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a620 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.753217:0:7643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a620 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061446.753245:0:7643:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a75aff800 from 1 10000000:01000000:1.0:1789061446.753247:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789061446.753286:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.753294:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.753304:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061446.753328:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473664:0@lo:101: 00000100:00100000:1.0:1789061446.753392:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.753429:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04000 going to sleep for 11 seconds 00000100:00100000:1.0:1789061446.753452:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779473664 00000100:00100000:1.0:1789061446.753556:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779473664 00000100:00100000:1.0:1789061446.753603:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789061446.753613:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:7643:x1875966779473664:12345-0@lo:101: 00010000:00010000:1.0:1789061446.753627:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061446.753639:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4cc85e00/0x427fa11dc4a9a63c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a635 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.753673:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4cc85e00/0x427fa11dc4a9a63c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a635 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.753683:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4cc85e00/0x427fa11dc4a9a63c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a635 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.753690:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4cc85e00, rc 0) 00000100:00100000:1.0:1789061446.753735:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:7643:x1875966779473664:12345-0@lo:101: Request processed in 124us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.753741:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789061446.753798:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473664:0@lo:101: 00010000:00010000:1.0:1789061446.753811:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a63c expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.753819:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a63c expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061446.753906:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473792:0@lo:501: 00000100:00100000:1.0:1789061446.753930:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.753951:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04000 going to sleep for 11 seconds 00000100:00100000:1.0:1789061446.754452:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779473792 00000100:00100000:1.0:1789061446.754457:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779473792 00000100:00100000:1.0:1789061446.754553:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789061446.754562:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:7643:x1875966779473792:12345-0@lo:501: 00000100:00100000:1.0:1789061446.754815:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:7643:x1875966779473792:12345-0@lo:501: Request processed in 254us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.754823:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789061446.761432:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473792:0@lo:501: 00000100:00100000:1.0:1789061446.761776:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473920:0@lo:503: 00000100:00100000:0.0:1789061446.761912:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.762053:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cb15900 going to sleep for 11 seconds 00000100:00100000:2.0:1789061446.762095:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779473920 00000100:00100000:2.0:1789061446.762102:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779473920 00000100:00100000:2.0:1789061446.762192:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789061446.762202:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:7643:x1875966779473920:12345-0@lo:503: 00000100:00100000:2.0:1789061446.762750:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:7643:x1875966779473920:12345-0@lo:503: Request processed in 548us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061446.762758:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789061446.762842:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779473920:0@lo:503: 00000040:00080000:0.0:1789061446.763155:0:7643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789061446.763222:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474048:0@lo:502: 00000100:00100000:0.0:1789061446.763260:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.763545:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4626e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061446.763786:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779474048 00000100:00100000:1.0:1789061446.763792:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779474048 00000100:00100000:0.0:1789061446.763877:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789061446.763890:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:7643:x1875966779474048:12345-0@lo:502: 00000100:00100000:0.0:1789061446.764119:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:7643:x1875966779474048:12345-0@lo:502: Request processed in 227us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061446.764128:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789061446.764462:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474048:0@lo:502: 00000040:00080000:1.0:1789061446.764769:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789061446.764826:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789061446.764855:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474176:0@lo:502: 00000100:00100000:1.0:1789061446.764896:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.764930:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cb15e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061446.765051:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779474176 00000100:00100000:0.0:1789061446.765057:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779474176 00000100:00100000:0.0:1789061446.765084:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789061446.765091:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:7643:x1875966779474176:12345-0@lo:502: 00000100:00100000:0.0:1789061446.765344:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:7643:x1875966779474176:12345-0@lo:502: Request processed in 253us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061446.765353:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789061446.767401:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474176:0@lo:502: 00000040:00080000:0.0:1789061446.767670:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789061446.767688:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789061446.768320:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061446.768330:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061446.768333:0:7655:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789061446.768339:0:7655:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff971a75aff800 00000020:00000080:0.0:1789061446.768341:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789061446.768358:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061446.768360:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061446.768362:0:7655:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789061446.768364:0:7655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789061446.768483:0:7643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789061446.768615:0:7643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789061446.768706:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a63c expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.768719:0:7643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a63c expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061446.768820:0:7643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789061446.768823:0:7643:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff971a75aff800 10000000:01000000:0.0:1789061446.768827:0:7643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff971a75aff800 10000000:01000000:0.0:1789061446.768831:0:7643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789061446.768837:0:7643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff971a75aff800 from 1 10000000:01000000:0.0:1789061446.768840:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789061446.768876:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.768903:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.768915:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061446.768937:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474304:0@lo:101: 00000100:00100000:0.0:1789061446.769027:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.769071:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a5cdfa300 going to sleep for 11 seconds 00000100:00100000:1.0:1789061446.769433:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779474304 00000100:00100000:1.0:1789061446.769441:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779474304 00000100:00100000:1.0:1789061446.769483:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789061446.769515:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:7643:x1875966779474304:12345-0@lo:101: 00010000:00010000:1.0:1789061446.769529:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061446.769546:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a64a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a643 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.769568:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a643 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.769579:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a643 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.769587:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4cc84e00, rc 0) 00000100:00100000:1.0:1789061446.769632:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+14:7643:x1875966779474304:12345-0@lo:101: Request processed in 119us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.769660:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789061446.769710:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474304:0@lo:101: 00010000:00010000:1.0:1789061446.769724:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a64a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.769734:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a64a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061446.769822:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474432:0@lo:501: 00000100:00100000:1.0:1789061446.769851:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.769873:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cb15900 going to sleep for 11 seconds 00000100:00100000:1.0:1789061446.769887:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779474432 00000100:00100000:1.0:1789061446.769891:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779474432 00000100:00100000:1.0:1789061446.769911:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789061446.769917:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+14:7643:x1875966779474432:12345-0@lo:501: 00000100:00100000:1.0:1789061446.770130:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+14:7643:x1875966779474432:12345-0@lo:501: Request processed in 212us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.770136:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789061446.770165:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474432:0@lo:501: 00000100:00100000:1.0:1789061446.770191:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474560:0@lo:503: 00000100:00100000:1.0:1789061446.770224:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.770236:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4626e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061446.770248:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779474560 00000100:00100000:1.0:1789061446.770252:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779474560 00000100:00100000:1.0:1789061446.770272:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789061446.770278:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+14:7643:x1875966779474560:12345-0@lo:503: 00000100:00100000:1.0:1789061446.770414:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+14:7643:x1875966779474560:12345-0@lo:503: Request processed in 135us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.770420:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789061446.770458:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474560:0@lo:503: 00000040:00080000:1.0:1789061446.770738:0:7643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789061446.770788:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474688:0@lo:502: 00000100:00100000:1.0:1789061446.770823:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.770839:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04900 going to sleep for 11 seconds 00000100:00100000:1.0:1789061446.770852:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779474688 00000100:00100000:1.0:1789061446.770855:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779474688 00000100:00100000:1.0:1789061446.770876:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789061446.770882:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+14:7643:x1875966779474688:12345-0@lo:502: 00000100:00100000:1.0:1789061446.771047:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+14:7643:x1875966779474688:12345-0@lo:502: Request processed in 163us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.771054:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789061446.771099:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474688:0@lo:502: 00000040:00080000:1.0:1789061446.771331:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789061446.771377:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789061446.771410:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789061446.771453:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789061446.771517:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789061446.771569:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789061446.771607:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789061446.771656:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789061446.771709:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789061446.771745:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789061446.771794:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789061446.771853:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789061446.771889:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789061446.771924:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789061446.771970:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789061446.772006:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789061446.772039:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789061446.772086:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789061446.772120:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789061446.772153:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789061446.772201:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789061446.772236:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789061446.772801:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789061446.772869:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789061446.772907:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789061446.772942:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789061446.774206:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789061446.774255:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1789061446.774291:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789061446.774339:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1789061446.774374:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1789061446.774406:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1789061446.774436:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1789061446.774739:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1789061446.774782:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1789061446.774827:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1789061446.774861:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1789061446.774910:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474816:0@lo:502: 00000100:00100000:0.0:1789061446.775077:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.775161:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a5cdfaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789061446.775202:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779474816 00000100:00100000:1.0:1789061446.775209:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779474816 00000100:00100000:1.0:1789061446.775297:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789061446.775308:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+14:7643:x1875966779474816:12345-0@lo:502: 00000100:00100000:1.0:1789061446.775771:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+14:7643:x1875966779474816:12345-0@lo:502: Request processed in 463us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.775778:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789061446.775922:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779474816:0@lo:502: 00000040:00080000:0.0:1789061446.776080:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1789061446.776092:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789061446.776754:0:7656:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789061446.776768:0:7656:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff971a47d619c0) 00000020:00000080:3.0:1789061446.776788:0:7656:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1789061446.776876:0:7656:0:(tgt_mount.c:153:server_get_mount()) get mount ffff971a75aff800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789061446.776880:0:7656:0:(tgt_mount.c:187:server_put_mount()) put mount ffff971a75aff800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789061446.776882:0:7656:0:(obd_mount.c:710:lustre_put_lsi()) put ffff971a75aff800 3 00010000:00080000:3.0:1789061446.776912:0:7656:0:(ldlm_lib.c:102:import_set_conn()) imp ffff971944d05800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1789061446.779053:0:7656:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789061446.779312:0:7656:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789061446.779350:0:7656:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789061446.779365:0:7656:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x427fa11dc4a9a658 00000100:00080000:3.0:1789061446.779375:0:7656:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789061446.779386:0:7656:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff971944d05800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789061446.779427:0:7656:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971a47c2b800 x1875966779474944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789061446.779455:0:7656:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789061446.779663:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875966779474944:0@lo:38: 00000100:00100000:2.0:1789061446.779738:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061446.779858:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779474944 00000100:00100000:3.0:1789061446.779867:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779474944 00000100:00100000:3.0:1789061446.779908:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061446.779916:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1875966779474944:12345-0@lo:38: 00010000:00080000:3.0:1789061446.779940:0:5852:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:3.0:1789061446.780048:0:5852:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x427fa11dc4a9a65f 00000004:00100000:3.0:1789061446.780067:0:5852:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789061446.780106:0:5852:0:(import.c:65:import_set_state_nolock()) ffff971a4d7d0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061446.780166:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875966779474944:12345-0@lo:38: Request processed in 248us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061446.780173:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789061446.780215:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a47c2b800 x1875966779474944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789061456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061446.780226:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789061446.780247:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789061446.780254:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789061446.780259:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789061446.780262:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971944d05800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789061446.780268:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875966779474944:0@lo:38: 00000100:00100000:1.0:1789061446.780407:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779475072:0@lo:400: 00000100:00100000:1.0:1789061446.780437:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.780462:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061446.780467:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779475200:0@lo:400: 00000100:00100000:1.0:1789061446.780509:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.780535:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061446.780543:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779475328:0@lo:400: 00000100:00100000:1.0:1789061446.780570:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.780853:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779475072 00000100:00100000:1.0:1789061446.780859:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779475072 00000100:00100000:1.0:1789061446.780885:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779475200 00000100:00100000:1.0:1789061446.780888:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779475200 00000100:00100000:1.0:1789061446.780912:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789061446.780919:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779475072:12345-0@lo:400: 00000100:00100000:1.0:1789061446.781035:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779475072:12345-0@lo:400: Request processed in 116us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.781045:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789061446.781061:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789061446.781068:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779475200:12345-0@lo:400: 00000100:00100000:1.0:1789061446.781098:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779475200:12345-0@lo:400: Request processed in 31us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.781104:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789061446.781125:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779475328 00000100:00100000:1.0:1789061446.781128:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779475328 00000100:00100000:1.0:1789061446.781153:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789061446.781159:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779475328:12345-0@lo:400: 00000100:00100000:1.0:1789061446.781191:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779475328:12345-0@lo:400: Request processed in 32us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.781196:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789061446.781211:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061446.781215:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789061446.781239:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971945c90700 x1875966779475328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061446.781249:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779475328:0@lo:400: 00010000:00080000:1.0:1789061446.781277:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971945c91180 x1875966779475200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061446.781301:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779475200:0@lo:400: 00010000:00080000:1.0:1789061446.781313:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971945c93100 x1875966779475072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061446.781323:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779475072:0@lo:400: 00000040:00080000:1.0:1789061446.781514:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1789061446.781682:0:7657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7657:1875966779475456:0@lo:901: 00000100:00100000:1.0:1789061446.781717:0:7657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.781747:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779475456 00000100:00100000:1.0:1789061446.781751:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779475456 00000100:00100000:1.0:1789061446.781780:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061446.781786:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7657:x1875966779475456:12345-0@lo:901: 00000100:00100000:1.0:1789061446.783865:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7657:x1875966779475456:12345-0@lo:901: Request processed in 2072us (2140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.783878:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789061446.783910:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061446.783928:0:7657:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cb15900 going to sleep for 11 seconds 00010000:00080000:1.0:1789061446.783953:0:7657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971945c93100 x1875966779475456/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789061462 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061446.783981:0:7657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7657:1875966779475456:0@lo:901: 00000020:01000000:1.0:1789061446.788104:0:7643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789061446.788147:0:7643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789061446.788174:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a64a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.788187:0:7643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a64a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789061446.788248:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789061446.788251:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789061446.788252:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061446.788253:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789061446.788255:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061446.788256:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061446.788257:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789061446.788259:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789061446.788260:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789061446.788262:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061446.788263:0:7643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789061446.788267:0:7643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789061446.788269:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789061446.788271:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789061446.788272:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061446.788273:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789061446.788274:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061446.788275:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061446.788276:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789061446.788277:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789061446.788278:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789061446.788279:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061446.788281:0:7643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789061446.788308:0:7643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789061446.788328:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779475584:0@lo:253: 00000100:00100000:1.0:1789061446.788403:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.788454:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d16e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789061446.788576:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779475584 00000100:00100000:0.0:1789061446.788585:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779475584 00000100:00100000:0.0:1789061446.788846:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789061446.788857:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+14:7643:x1875966779475584:12345-0@lo:253: 20000000:01000000:0.0:1789061446.788886:0:5845:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789061446.788899:0:5845:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789061446.814153:0:5845:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789061446.814172:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789061446.814281:0:5867:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789061446.814286:0:5867:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789061446.814309:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.814328:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a5b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a5b0 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.814352:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.814391:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a5b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a5b0 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.814404:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a5b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5b0 expref: 14 pid: 5845 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061446.814419:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c90700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1875966779475712:0@lo:104: 00000100:00100000:1.0:1789061446.814481:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061446.814546:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a43fa6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061446.814671:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779475712 00000100:00100000:0.0:1789061446.814680:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779475712 00000100:00100000:0.0:1789061446.814731:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789061446.814741:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+3:5867:x1875966779475712:12345-0@lo:104: 00010000:00010000:0.0:1789061446.814754:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a5b7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.814814:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789061446.814820:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+3:5867:x1875966779475712:12345-0@lo:104: Request processed in 82us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061446.814827:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789061446.814850:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061446.814856:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a5b7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.814864:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc84400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061446.814867:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a5b7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.814874:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a5b7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061446.814881:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a5b7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061446.814897:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789061446.814924:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a5b7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.814929:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061446.814946:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a5b7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.814952:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4cc84400/0x427fa11dc4a9a5b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a5b7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.814975:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061446.814977:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061446.814979:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061446.814998:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779475840:0@lo:103: 00000100:00100000:0.0:1789061446.815028:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061446.815065:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779475840 00000100:00100000:0.0:1789061446.815069:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779475840 00010000:00010000:0.0:1789061446.815085:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a5b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5b0 expref: 15 pid: 5845 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061446.815108:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789061446.815115:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+15:3313:x1875966779475840:12345-0@lo:103: 00010000:00010000:0.0:1789061446.815125:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061446.815129:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a5b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5b0 expref: 15 pid: 5845 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.815139:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a5b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a5b0 expref: 15 pid: 5845 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.815161:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.815170:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789061446.815184:0:5836:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002694636s 00010000:00010000:0.0:1789061446.815188:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.815195:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.815202:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.815208:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.815213:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc85800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061446.815218:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.815226:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.815235:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061446.815244:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061446.815273:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+15:3313:x1875966779475840:12345-0@lo:103: Request processed in 159us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061446.815285:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789061446.815344:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779475840:0@lo:103: 00010000:00010000:1.0:1789061446.815461:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a5b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a5b0 expref: 14 pid: 5845 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061446.815471:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c90700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1875966779475712:0@lo:104: 00010000:00010000:1.0:1789061446.815544:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.815555:0:5867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.815561:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061446.815568:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4cc85800/0x427fa11dc4a9a666 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061446.824061:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:7643:x1875966779475584:12345-0@lo:253: Request processed in 35197us (35647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061446.824090:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789061446.824243:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:24dfd7ac-7455-4043-9449-a564380782df:7643:1875966779475584:0@lo:253: 10000000:01000000:0.0:1789061446.824258:0:7643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789061446.824261:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789061446.824262:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789061446.824264:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061446.824265:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061446.824266:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061446.824267:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061446.824269:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789061446.824270:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789061446.824272:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789061446.824273:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061446.824275:0:7643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789061446.824290:0:7643:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789061446.829207:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789061446.829383:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789061446.829697:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789061446.829838:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789061446.830088:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789061446.830297:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789061446.831222:0:7643:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789061447.097086:0:7643:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789061447.097095:0:7643:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789061447.097140:0:7643:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789061447.097208:0:7643:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789061447.097224:0:7643:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789061447.097260:0:7643:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:0.0:1789061447.424870:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061447.424897:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779475968:0@lo:13: 00000100:00100000:0.0:1789061447.427569:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061447.427798:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779475968 00000100:00100000:1.0:1789061447.427810:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779475968 00000100:00100000:1.0:1789061447.427868:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789061447.427878:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779475968:12345-0@lo:13: 00002000:00000024:1.0:1789061447.427928:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061447.428171:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779475968:12345-0@lo:13: Request processed in 292us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061447.428178:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789061447.428364:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971a7c2b5500 x1875966779475968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061447.428388:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779475968:0@lo:13: 00010000:00010000:1.0:1789061447.554740:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061448.573782:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061449.603780:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061450.621815:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061451.646549:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061452.030227:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779476480:0@lo:400: 00000100:00100000:3.0:1789061452.030306:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061452.030371:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789061452.030378:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779476096:0@lo:400: 00000100:00100000:3.0:1789061452.030407:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061452.030427:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875966779476608:0@lo:400: 00000100:00100000:3.0:1789061452.030451:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061452.030478:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779476224:0@lo:400: 00000100:00100000:3.0:1789061452.030518:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061452.030537:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061452.030552:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779476352:0@lo:400: 00000100:00100000:3.0:1789061452.030574:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061452.031217:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779476608 00000100:00100000:2.0:1789061452.031227:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779476608 00000100:00100000:2.0:1789061452.031274:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779476224 00000100:00100000:2.0:1789061452.031277:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779476224 00000100:00100000:2.0:1789061452.031288:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779476352 00000100:00100000:2.0:1789061452.031290:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779476352 00000100:00100000:2.0:1789061452.031304:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789061452.031312:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875966779476608:12345-0@lo:400: 00000100:00100000:2.0:1789061452.031368:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875966779476608:12345-0@lo:400: Request processed in 56us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061452.031374:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789061452.031388:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789061452.031393:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779476224:12345-0@lo:400: 00000100:00100000:2.0:1789061452.031416:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779476224:12345-0@lo:400: Request processed in 23us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061452.031421:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789061452.031431:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789061452.031443:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779476352:12345-0@lo:400: 00000100:00100000:2.0:1789061452.031471:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779476352:12345-0@lo:400: Request processed in 29us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061452.031476:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789061452.031521:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061452.031820:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779476096 00000100:00100000:1.0:1789061452.031895:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779476096 00000100:00100000:1.0:1789061452.031936:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789061452.031944:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+13:3310:x1875966779476096:12345-0@lo:400: 00000100:00100000:1.0:1789061452.031982:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+13:3310:x1875966779476096:12345-0@lo:400: Request processed in 40us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061452.031988:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1789061452.032245:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a47c29c00 x1875966779476352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061452.032260:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779476352:0@lo:400: 00010000:00080000:3.0:1789061452.032284:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a47c2ad80 x1875966779476224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061452.032293:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779476224:0@lo:400: 00000100:00100000:3.0:1789061452.032331:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779476480 00000100:00100000:3.0:1789061452.032336:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779476480 00000100:00100000:3.0:1789061452.032379:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789061452.032384:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061452.032386:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779476480:12345-0@lo:400: 00000100:00100000:3.0:1789061452.032422:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779476480:12345-0@lo:400: Request processed in 36us (2116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061452.032427:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789061452.032461:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779476096:0@lo:400: 00010000:00080000:3.0:1789061452.032473:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a47c2aa00 x1875966779476608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061452.032483:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875966779476608:0@lo:400: 00010000:00080000:3.0:1789061452.032520:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a47c28a80 x1875966779476480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061452.032529:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779476480:0@lo:400: 00000100:00100000:2.0:1789061452.542600:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779476736:0@lo:13: 00000100:00100000:2.0:1789061452.542677:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061452.542757:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779476736 00000100:00100000:2.0:1789061452.542765:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779476736 00000100:00100000:2.0:1789061452.542817:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789061452.542826:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779476736:12345-0@lo:13: 00002000:00000024:2.0:1789061452.542862:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061452.542906:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779476736:12345-0@lo:13: Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061452.542912:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789061452.542958:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a76194a80 x1875966779476736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061452.542976:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779476736:0@lo:13: 00010000:00010000:0.0:1789061452.671053:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061453.709974:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789061454.359520:0:8000:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1789061454.590575:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789061454.590582:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff971a7618e800 from 30 10000000:01000000:0.0:1789061454.590587:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789061454.590640:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.590652:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.590663:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061454.590687:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779476864:0@lo:101: 00000100:00100000:0.0:1789061454.590781:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.590836:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.591048:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779476864 00000100:00100000:2.0:1789061454.591065:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779476864 00000100:00100000:2.0:1789061454.592389:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789061454.592409:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+13:5848:x1875966779476864:12345-0@lo:101: 00010000:00010000:2.0:1789061454.592444:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061454.592469:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a674 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a66d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.592561:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a66d expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.592575:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a66d expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.592586:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fa00, rc 0) 00000100:00100000:2.0:1789061454.592680:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779476864:12345-0@lo:101: Request processed in 278us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.592688:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789061454.592733:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779476864:0@lo:101: 00010000:00010000:0.0:1789061454.592878:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a674 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.592892:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a674 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061454.593312:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779476992:0@lo:501: 00000100:00100000:0.0:1789061454.593382:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.593436:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.593560:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779476992 00000100:00100000:2.0:1789061454.593571:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779476992 00000100:00100000:2.0:1789061454.593658:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789061454.593667:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779476992:12345-0@lo:501: 00000100:00100000:2.0:1789061454.594051:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779476992:12345-0@lo:501: Request processed in 384us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.594059:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789061454.594105:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779476992:0@lo:501: 00000100:00100000:0.0:1789061454.594140:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779477120:0@lo:503: 00000100:00100000:0.0:1789061454.594188:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.599041:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789061454.599465:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779477120 00000100:00100000:3.0:1789061454.599483:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779477120 00000100:00100000:3.0:1789061454.599618:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789061454.599630:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779477120:12345-0@lo:503: 00000100:00100000:3.0:1789061454.600258:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779477120:12345-0@lo:503: Request processed in 629us (6067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061454.600268:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789061454.601078:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779477120:0@lo:503: 00000100:00100000:3.0:1789061454.604403:0:8016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8016:1875966779477248:0@lo:502: 00000100:00100000:3.0:1789061454.604582:0:8016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061454.604633:0:8016:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4626e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.604705:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779477248 00000100:00100000:2.0:1789061454.604715:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779477248 00000100:00100000:2.0:1789061454.604796:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789061454.604809:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+14:8016:x1875966779477248:12345-0@lo:502: 00000100:00100000:2.0:1789061454.605879:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+14:8016:x1875966779477248:12345-0@lo:502: Request processed in 1067us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.605893:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789061454.606126:0:8016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8016:1875966779477248:0@lo:502: 00000100:00100000:3.0:1789061454.606225:0:8016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8016:1875966779477376:0@lo:502: 00000100:00100000:3.0:1789061454.606269:0:8016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061454.606295:0:8016:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f47180 going to sleep for 11 seconds 00000100:00100000:0.0:1789061454.607737:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779477376 00000100:00100000:0.0:1789061454.607761:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779477376 00000100:00100000:0.0:1789061454.607825:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789061454.607836:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+14:8016:x1875966779477376:12345-0@lo:502: 00000100:00100000:0.0:1789061454.608127:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+14:8016:x1875966779477376:12345-0@lo:502: Request processed in 293us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061454.608136:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789061454.608531:0:8016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8016:1875966779477376:0@lo:502: 00000040:00080000:3.0:1789061454.608572:0:8016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789061454.608830:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789061454.608850:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789061454.608861:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a674 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.608880:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a674 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061454.608890:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789061454.608892:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789061454.608896:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789061454.608929:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.608937:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.608946:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061454.608979:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779477504:0@lo:101: 00000100:00100000:2.0:1789061454.609025:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061454.609066:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4f74c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789061454.609214:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779477504 00000100:00100000:3.0:1789061454.609300:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779477504 00000100:00100000:3.0:1789061454.609343:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789061454.609351:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779477504:12345-0@lo:101: 00010000:00010000:3.0:1789061454.609364:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061454.609378:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a67b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061454.609402:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a67b expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061454.609412:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a67b expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061454.609421:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476a00, rc 0) 00000100:00100000:3.0:1789061454.609470:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779477504:12345-0@lo:101: Request processed in 119us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061454.609476:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789061454.609645:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779477504:0@lo:101: 00010000:00010000:2.0:1789061454.609659:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a682 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.609667:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a682 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061454.610291:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779477632:0@lo:501: 00000100:00100000:2.0:1789061454.610330:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061454.610372:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4f74c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789061454.610850:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779477632 00000100:00100000:3.0:1789061454.610857:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779477632 00000100:00100000:3.0:1789061454.610892:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789061454.610899:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779477632:12345-0@lo:501: 00000100:00100000:3.0:1789061454.611178:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779477632:12345-0@lo:501: Request processed in 279us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061454.611186:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789061454.611381:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779477632:0@lo:501: 00000100:00100000:0.0:1789061454.611419:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779477760:0@lo:503: 00000100:00100000:0.0:1789061454.611460:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.611815:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2300 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.611892:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779477760 00000100:00100000:2.0:1789061454.611898:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779477760 00000100:00100000:2.0:1789061454.615450:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789061454.615470:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779477760:12345-0@lo:503: 00000100:00100000:2.0:1789061454.616834:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779477760:12345-0@lo:503: Request processed in 1368us (5368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.616845:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789061454.616874:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779477760:0@lo:503: 00000100:00100000:3.0:1789061454.626358:0:8017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8017:1875966779477888:0@lo:502: 00000100:00100000:3.0:1789061454.626466:0:8017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061454.626539:0:8017:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f47540 going to sleep for 11 seconds 00000100:00100000:0.0:1789061454.626683:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779477888 00000100:00100000:0.0:1789061454.626690:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779477888 00000100:00100000:0.0:1789061454.626732:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789061454.626741:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+15:8017:x1875966779477888:12345-0@lo:502: 00000100:00100000:0.0:1789061454.627148:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+15:8017:x1875966779477888:12345-0@lo:502: Request processed in 407us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061454.627156:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789061454.628282:0:8017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8017:1875966779477888:0@lo:502: 00000020:01000000:3.0:1789061454.628318:0:8017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061454.628328:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061454.628330:0:8017:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789061454.628334:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789061454.628336:0:8017:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789061454.628360:0:8017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8017:1875966779478016:0@lo:502: 00000100:00100000:3.0:1789061454.628405:0:8017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061454.628471:0:8017:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f47540 going to sleep for 11 seconds 00000100:00100000:0.0:1789061454.628837:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779478016 00000100:00100000:0.0:1789061454.628843:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779478016 00000100:00100000:0.0:1789061454.628911:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789061454.628920:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+15:8017:x1875966779478016:12345-0@lo:502: 00000100:00100000:0.0:1789061454.629103:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+15:8017:x1875966779478016:12345-0@lo:502: Request processed in 183us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061454.629110:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789061454.629242:0:8017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8017:1875966779478016:0@lo:502: 00000020:01000000:3.0:1789061454.629262:0:8017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061454.629266:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061454.629268:0:8017:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789061454.629271:0:8017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1789061454.629447:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789061454.629478:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789061454.629681:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a682 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.629693:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a682 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061454.629702:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789061454.629705:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff971a46ca8000 from 30 10000000:01000000:0.0:1789061454.629708:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789061454.629735:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.629742:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.629750:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061454.629835:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779478144:0@lo:101: 00000100:00100000:0.0:1789061454.629870:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.629891:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.632136:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779478144 00000100:00100000:2.0:1789061454.632149:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779478144 00000100:00100000:2.0:1789061454.632206:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789061454.632224:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779478144:12345-0@lo:101: 00010000:00010000:2.0:1789061454.632241:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061454.632259:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a689 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.632285:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a689 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.632296:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a689 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.632304:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e200, rc 0) 00000100:00100000:2.0:1789061454.632382:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779478144:12345-0@lo:101: Request processed in 167us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.632389:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789061454.632718:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779478144:0@lo:101: 00010000:00010000:0.0:1789061454.632735:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.632746:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061454.632888:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779478272:0@lo:501: 00000100:00100000:0.0:1789061454.632928:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.633033:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.633250:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779478272 00000100:00100000:2.0:1789061454.633256:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779478272 00000100:00100000:2.0:1789061454.633296:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789061454.633310:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779478272:12345-0@lo:501: 00000100:00100000:2.0:1789061454.633598:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779478272:12345-0@lo:501: Request processed in 288us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.633605:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789061454.633896:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779478272:0@lo:501: 00000100:00100000:0.0:1789061454.633927:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779478400:0@lo:503: 00000100:00100000:0.0:1789061454.633965:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.633994:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061454.634044:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779478400 00000100:00100000:3.0:1789061454.634049:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779478400 00000100:00100000:3.0:1789061454.634075:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789061454.634082:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779478400:12345-0@lo:503: 00000100:00100000:3.0:1789061454.634250:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779478400:12345-0@lo:503: Request processed in 167us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061454.634256:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789061454.634374:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779478400:0@lo:503: 00000100:00100000:3.0:1789061454.634766:0:8018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8018:1875966779478528:0@lo:502: 00000100:00100000:3.0:1789061454.634805:0:8018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061454.634834:0:8018:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f473c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061454.634882:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779478528 00000100:00100000:0.0:1789061454.634887:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779478528 00000100:00100000:0.0:1789061454.634918:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789061454.634925:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+16:8018:x1875966779478528:12345-0@lo:502: 00000100:00100000:0.0:1789061454.635104:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+16:8018:x1875966779478528:12345-0@lo:502: Request processed in 177us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061454.635111:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789061454.635202:0:8018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c28a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8018:1875966779478528:0@lo:502: 00000100:00100000:2.0:1789061454.635256:0:8018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76196680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8018:1875966779478656:0@lo:502: 00000100:00100000:2.0:1789061454.635287:0:8018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061454.635310:0:8018:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4523df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789061454.635424:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779478656 00000100:00100000:0.0:1789061454.635429:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779478656 00000100:00100000:0.0:1789061454.635460:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789061454.635466:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:8018:x1875966779478656:12345-0@lo:502: 00000100:00100000:0.0:1789061454.635618:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:8018:x1875966779478656:12345-0@lo:502: Request processed in 152us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061454.635625:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789061454.635763:0:8018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76196680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8018:1875966779478656:0@lo:502: 00000040:00080000:2.0:1789061454.635783:0:8018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789061454.636313:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789061454.636331:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789061454.636341:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.636365:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061454.636376:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789061454.636378:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff971a46ca8000 from 5 10000000:01000000:0.0:1789061454.636381:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789061454.636411:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.636420:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.636429:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061454.636443:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779478784:0@lo:101: 00000100:00100000:0.0:1789061454.636477:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.636541:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.636686:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779478784 00000100:00100000:2.0:1789061454.636691:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779478784 00000100:00100000:2.0:1789061454.636725:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789061454.636732:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779478784:12345-0@lo:101: 00010000:00010000:2.0:1789061454.636742:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061454.636754:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63f200/0x427fa11dc4a9a69e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a697 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.636775:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63f200/0x427fa11dc4a9a69e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a697 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.636786:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63f200/0x427fa11dc4a9a69e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a697 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.636795:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f200, rc 0) 00000100:00100000:2.0:1789061454.636831:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779478784:12345-0@lo:101: Request processed in 99us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.636846:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789061454.636930:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779478784:0@lo:101: 00010000:00010000:0.0:1789061454.636941:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.636951:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061454.636993:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779478912:0@lo:256: 00000100:00100000:0.0:1789061454.637021:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.637048:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.637319:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779478912 00000100:00100000:2.0:1789061454.637324:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779478912 00000100:00100000:2.0:1789061454.637355:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789061454.637362:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779478912:12345-0@lo:256: 20000000:01000000:2.0:1789061454.637374:0:5845:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789061454.637389:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789061454.637392:0:5845:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789061454.638411:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779478912:12345-0@lo:256: Request processed in 1045us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.638421:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789061454.638527:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779478912:0@lo:256: 10000000:01000000:3.0:1789061454.638575:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789061454.638583:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061454.638593:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061454.638602:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789061454.638604:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789061454.638607:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789061454.638632:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061454.638640:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061454.638649:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061454.638665:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779479040:0@lo:101: 00000100:00100000:3.0:1789061454.638695:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061454.638729:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f47e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061454.639245:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779479040 00000100:00100000:0.0:1789061454.639253:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779479040 00000100:00100000:0.0:1789061454.639288:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789061454.639296:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779479040:12345-0@lo:101: 00010000:00010000:0.0:1789061454.639307:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061454.639320:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a40030600/0x427fa11dc4a9a6ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a6a5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.639340:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a40030600/0x427fa11dc4a9a6ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a6a5 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.639350:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a40030600/0x427fa11dc4a9a6ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a6a5 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.639358:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40030600, rc 0) 00000100:00100000:0.0:1789061454.639396:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779479040:12345-0@lo:101: Request processed in 101us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061454.639403:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789061454.641401:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779479040:0@lo:101: 00010000:00010000:3.0:1789061454.641431:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a6ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061454.641443:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a6ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061454.641721:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779479168:0@lo:501: 00000100:00100000:3.0:1789061454.641775:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061454.641852:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f47e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.641960:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779479168 00000100:00100000:2.0:1789061454.641967:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779479168 00000100:00100000:2.0:1789061454.642045:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789061454.642055:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779479168:12345-0@lo:501: 00000100:00100000:2.0:1789061454.642362:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779479168:12345-0@lo:501: Request processed in 308us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.642370:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789061454.642435:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779479168:0@lo:501: 00000100:00100000:3.0:1789061454.642469:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779479296:0@lo:503: 00000100:00100000:3.0:1789061454.642557:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061454.642876:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f47e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061454.642923:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779479296 00000100:00100000:0.0:1789061454.642929:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779479296 00000100:00100000:0.0:1789061454.642956:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789061454.642962:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779479296:12345-0@lo:503: 00000100:00100000:0.0:1789061454.643339:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779479296:12345-0@lo:503: Request processed in 242us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061454.643348:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789061454.643948:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779479296:0@lo:503: 00000100:00100000:3.0:1789061454.644715:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8019:1875966779479424:0@lo:502: 00000100:00100000:3.0:1789061454.644772:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061454.644900:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f47300 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.644934:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779479424 00000100:00100000:2.0:1789061454.644941:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779479424 00000100:00100000:2.0:1789061454.645009:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789061454.645020:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:8019:x1875966779479424:12345-0@lo:502: 00000100:00100000:2.0:1789061454.648137:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:8019:x1875966779479424:12345-0@lo:502: Request processed in 3111us (3356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.648151:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789061454.648961:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8019:1875966779479424:0@lo:502: 00000020:01000000:3.0:1789061454.649005:0:8019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789061454.649012:0:8019:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789061454.649020:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061454.649022:0:8019:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789061454.649027:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789061454.649031:0:8019:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:3.0:1789061454.649055:0:8019:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789061454.649068:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789061454.649092:0:8019:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff971a760a8000) 00000020:00000080:3.0:1789061454.649111:0:8019:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789061454.649117:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789061454.649201:0:8019:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789061454.649214:0:8019:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789061454.649296:0:8019:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9a6ba 00010000:00080000:3.0:1789061454.649327:0:8019:0:(ldlm_lib.c:102:import_set_conn()) imp ffff971a7cb44800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1789061454.649572:0:8019:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1789061454.655778:0:8019:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789061454.655798:0:8019:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789061454.656649:0:8019:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061454.656928:0:8019:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061454.656981:0:8019:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789061454.657040:0:8019:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789061454.658064:0:8021:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789061454.658075:0:8021:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789061454.661714:0:8019:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789061454.661729:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789061454.661776:0:8019:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789061454.661803:0:8019:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x427fa11dc4a9a6c1 00000100:00080000:2.0:1789061454.661826:0:8019:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789061454.661838:0:8019:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff971a7cb44800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789061454.661873:0:8019:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971a76196680 x1875966779479552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789061454.661898:0:8019:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789061454.661954:0:8019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061454.661958:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061454.661960:0:8019:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789061454.661963:0:8019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061454.661980:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061454.661982:0:8019:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789061454.661986:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789061454.661988:0:8019:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789061454.662015:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76196a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8019:1875966779479680:0@lo:502: 00000100:00100000:2.0:1789061454.662093:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061454.662128:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4523d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.662204:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779479808:0@lo:400: 00000100:00100000:2.0:1789061454.662431:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061454.662454:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061454.662461:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779480192:0@lo:400: 00000100:00100000:2.0:1789061454.662480:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061454.662548:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779479936:0@lo:400: 00000100:00100000:2.0:1789061454.662570:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061454.662587:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061454.662591:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779480064:0@lo:400: 00000100:00100000:2.0:1789061454.662612:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061454.662651:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779479808 00000100:00100000:2.0:1789061454.662658:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779479808 00000100:00100000:2.0:1789061454.662691:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779480192 00000100:00100000:2.0:1789061454.662694:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779480192 00000100:00100000:2.0:1789061454.662712:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779479936 00000100:00100000:2.0:1789061454.662714:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779479936 00000100:00100000:2.0:1789061454.662728:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789061454.662736:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779479808:12345-0@lo:400: 00000100:00100000:2.0:1789061454.662785:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779479808:12345-0@lo:400: Request processed in 49us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.662792:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789061454.662877:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789061454.662884:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779480192:12345-0@lo:400: 00000100:00100000:2.0:1789061454.662913:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779480192:12345-0@lo:400: Request processed in 30us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.662918:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789061454.662930:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789061454.662936:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779479936:12345-0@lo:400: 00000100:00100000:2.0:1789061454.663312:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779479936:12345-0@lo:400: Request processed in 374us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.663320:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789061454.663361:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789061454.663389:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a76197480 x1875966779480192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061454.663403:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779480192:0@lo:400: 00010000:00080000:2.0:1789061454.663413:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a76195500 x1875966779479808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061454.663433:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779479808:0@lo:400: 00010000:00080000:2.0:1789061454.663464:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a76194e00 x1875966779479936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061454.663473:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779479936:0@lo:400: 00000100:00100000:2.0:1789061454.663526:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779479680 00000100:00100000:2.0:1789061454.663530:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779479680 00000100:00100000:2.0:1789061454.663557:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789061454.663564:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:8019:x1875966779479680:12345-0@lo:502: 00000100:00100000:2.0:1789061454.663797:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:8019:x1875966779479680:12345-0@lo:502: Request processed in 233us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.663803:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789061454.663929:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779479552:0@lo:8: 00000100:00100000:0.0:1789061454.663979:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.664022:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779480064 00000100:00100000:0.0:1789061454.664032:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779480064 00000100:00100000:0.0:1789061454.664064:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779479552 00000100:00100000:0.0:1789061454.664067:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779479552 00000100:00100000:0.0:1789061454.664078:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789061454.664084:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779480064:12345-0@lo:400: 00000100:00100000:0.0:1789061454.664121:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779480064:12345-0@lo:400: Request processed in 37us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061454.664127:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789061454.664139:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789061454.664143:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1875966779479552:12345-0@lo:8: 00010000:00080000:0.0:1789061454.664164:0:6702:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:0.0:1789061454.664192:0:6702:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x427fa11dc4a9a6c8 00002000:00100000:0.0:1789061454.664205:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff971a68187000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789061454.664210:0:6702:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1789061454.664214:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789061454.664341:0:6702:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789061454.664525:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789061454.664550:0:6702:0:(import.c:65:import_set_state_nolock()) ffff971a68186000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789061454.664588:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875966779479552:12345-0@lo:8: Request processed in 443us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061454.664595:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789061454.664625:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a76196680 x1875966779479552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789061464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061454.664634:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789061454.664641:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789061454.664649:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789061454.664653:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789061454.664662:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971a7cb44800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789061454.664679:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789061454.664683:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779479552:0@lo:8: 00000100:00080000:0.0:1789061454.664704:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789061454.664723:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a76195180 x1875966779480064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061454.664732:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779480064:0@lo:400: 00000004:00080000:3.0:1789061454.665072:0:8021:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789061454.665167:0:8021:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 228906677087ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789061454.666042:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76196a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8019:1875966779479680:0@lo:502: 00000020:01000000:2.0:1789061454.666075:0:8019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061454.666082:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061454.666084:0:8019:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789061454.666088:0:8019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789061454.666381:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789061454.666407:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789061454.666419:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a6ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.666431:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a6ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061454.666440:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789061454.666443:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff971a47d64d40 from 1 10000000:01000000:0.0:1789061454.666446:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789061454.666481:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.666523:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061454.666531:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061454.666553:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779480320:0@lo:101: 00000100:00100000:0.0:1789061454.666605:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.666649:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.666770:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779480320 00000100:00100000:2.0:1789061454.666778:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779480320 00000100:00100000:2.0:1789061454.667046:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789061454.667058:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779480320:12345-0@lo:101: 00010000:00010000:2.0:1789061454.667071:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061454.667084:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a6d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a6cf expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.667110:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a6cf expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.667128:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a6cf expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.667137:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f000, rc 0) 00000100:00100000:2.0:1789061454.667189:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779480320:12345-0@lo:101: Request processed in 134us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.667195:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789061454.667534:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779480320:0@lo:101: 00010000:00010000:2.0:1789061454.667549:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a6d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.667558:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a6d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061454.667613:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76196a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779480448:0@lo:501: 00000100:00100000:2.0:1789061454.667642:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061454.667665:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4523d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.667681:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779480448 00000100:00100000:2.0:1789061454.667685:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779480448 00000100:00100000:2.0:1789061454.667704:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789061454.667710:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779480448:12345-0@lo:501: 00000100:00100000:2.0:1789061454.668653:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779480448:12345-0@lo:501: Request processed in 940us (1008us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789061454.668663:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789061454.668707:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76196a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779480448:0@lo:501: 10000000:01000000:2.0:1789061454.668736:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789061454.668750:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a6d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061454.668759:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a6d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789061454.718410:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789061454.718617:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789061454.719770:0:8022:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789061454.719805:0:8022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875966779480704:0@lo:7: 00000100:00100000:2.0:1789061454.719891:0:8022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061454.719925:0:8022:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4523d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061454.719943:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061454.719955:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779480576:0@lo:13: 00000100:00100000:2.0:1789061454.719980:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061454.720010:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779480576 00000100:00100000:2.0:1789061454.720018:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779480576 00000100:00100000:2.0:1789061454.720081:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789061454.720089:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875966779480576:12345-0@lo:13: 00002000:00000024:2.0:1789061454.720125:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789061454.720171:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875966779480576:12345-0@lo:13: Request processed in 82us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061454.720177:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789061454.720292:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a76196a00 x1875966779480576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061454.720312:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779480576:0@lo:13: 00000100:00100000:1.0:1789061454.720524:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779480704 00000100:00100000:1.0:1789061454.720549:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779480704 00000100:00100000:1.0:1789061454.720580:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789061454.720587:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8022:x1875966779480704:12345-0@lo:7: 00000100:00080000:0.0:1789061454.722107:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1789061454.743534:0:6702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789061454.743625:0:6702:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789061454.743727:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8022:x1875966779480704:12345-0@lo:7: Request processed in 23135us (23831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061454.743738:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789061454.743863:0:8022:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a76194e00 x1875966779480704/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789061470 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061454.743879:0:8022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875966779480704:0@lo:7: 00000004:00080000:0.0:1789061454.743892:0:8022:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789061454.743930:0:8022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875966779480832:0@lo:5: 00000100:00100000:0.0:1789061454.743965:0:8022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.744013:0:8022:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789061454.744305:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779480832 00000100:00100000:3.0:1789061454.744322:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779480832 00000100:00100000:3.0:1789061454.744367:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789061454.744377:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8022:x1875966779480832:12345-0@lo:5: 00002000:00080000:3.0:1789061454.744404:0:6699:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789061454.744407:0:6699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789061454.744755:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8022:x1875966779480832:12345-0@lo:5: Request processed in 379us (788us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789061454.744769:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789061454.744964:0:8022:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c2b7800 x1875966779480832/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789061470 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061454.744976:0:8022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875966779480832:0@lo:5: 00000004:00080000:0.0:1789061454.744987:0:8022:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789061454.745017:0:8022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875966779480960:0@lo:700: 00000100:00100000:0.0:1789061454.745044:0:8022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.745063:0:8022:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061454.745077:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779480960 00000100:00100000:0.0:1789061454.745082:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779480960 00000100:00100000:0.0:1789061454.745118:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789061454.745126:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8022:x1875966779480960:12345-0@lo:700: 00000100:00100000:0.0:1789061454.745154:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6708:1875966779481088:0@lo:700: 00000100:00100000:0.0:1789061454.745189:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061454.745208:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061454.745304:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779481088 00000100:00100000:0.0:1789061454.745309:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779481088 00000100:00100000:0.0:1789061454.745339:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789061454.745354:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6708:x1875966779481088:12345-0@lo:700: 40000000:02000000:2.0:1789061454.804387:0:5858:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1789061454.828028:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6708:x1875966779481088:12345-0@lo:700: Request processed in 82664us (82826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061454.828044:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789061454.828174:0:6708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c2b4e00 x1875966779481088/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789061470 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061454.828190:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6708:1875966779481088:0@lo:700: 40000000:02000000:2.0:1789061454.828206:0:6708:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:2.0:1789061454.980354:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789061454.980374:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1789061454.981037:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8022:x1875966779480960:12345-0@lo:700: Request processed in 235906us (235986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061454.981049:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789061454.981151:0:8022:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c2b6300 x1875966779480960/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789061470 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061454.981163:0:8022:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789061454.981179:0:8022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875966779480960:0@lo:700: 00000004:02000040:2.0:1789061455.058868:0:8022:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789061455.062833:0:8022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875966779481216:0@lo:5: 00000100:00100000:0.0:1789061455.062907:0:8022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061455.063007:0:8022:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789061455.063133:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779481216 00000100:00100000:3.0:1789061455.063141:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779481216 00000100:00100000:3.0:1789061455.063229:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789061455.063240:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8022:x1875966779481216:12345-0@lo:5: 00002000:00080000:3.0:1789061455.069170:0:6702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789061455.069191:0:6702:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789061455.072633:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8022:x1875966779481216:12345-0@lo:5: Request processed in 9388us (9719us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789061455.072647:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789061455.072873:0:8022:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c2b5500 x1875966779481216/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789061471 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061455.072891:0:8022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875966779481216:0@lo:5: 00000004:00080000:0.0:1789061455.072906:0:8022:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1789061455.745907:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061456.765911:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061457.664229:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061457.664257:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779481344:0@lo:13: 00000100:00100000:1.0:1789061457.664332:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061457.664759:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779481344 00000100:00100000:1.0:1789061457.664768:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779481344 00000100:00100000:1.0:1789061457.665382:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789061457.665406:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779481344:12345-0@lo:13: 00002000:00000024:1.0:1789061457.665456:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061457.665538:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779481344:12345-0@lo:13: Request processed in 135us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061457.665546:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789061457.666558:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971945c90700 x1875966779481344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061457.666582:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779481344:0@lo:13: 00000100:00080000:3.0:1789061457.669632:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789061457.789823:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061458.814698:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061459.713181:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875966779481728:0@lo:400: 00000100:00100000:3.0:1789061459.713253:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061459.713310:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789061459.713316:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779481600:0@lo:400: 00000100:00100000:3.0:1789061459.713338:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061459.713355:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779482112:0@lo:400: 00000100:00100000:3.0:1789061459.713411:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061459.713475:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779482112 00000100:00100000:3.0:1789061459.713516:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779482112 00000100:00100000:3.0:1789061459.713579:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789061459.713589:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779482112:12345-0@lo:400: 00000100:00100000:3.0:1789061459.713641:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779482112:12345-0@lo:400: Request processed in 53us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061459.713648:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789061459.713677:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789061459.713709:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a47c2a300 x1875966779482112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061459.713737:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779482112:0@lo:400: 00000100:00100000:2.0:1789061459.714305:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779481472:0@lo:400: 00000100:00100000:2.0:1789061459.714349:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061459.714387:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779481984:0@lo:400: 00000100:00100000:2.0:1789061459.714433:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061459.714653:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789061459.714661:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779481856:0@lo:400: 00000100:00100000:2.0:1789061459.714684:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061459.714733:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779481728 00000100:00100000:2.0:1789061459.714739:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779481728 00000100:00100000:2.0:1789061459.714772:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779481600 00000100:00100000:2.0:1789061459.714775:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779481600 00000100:00100000:2.0:1789061459.714787:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779481984 00000100:00100000:2.0:1789061459.714789:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779481984 00000100:00100000:2.0:1789061459.714817:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789061459.714824:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875966779481728:12345-0@lo:400: 00000100:00100000:2.0:1789061459.714868:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875966779481728:12345-0@lo:400: Request processed in 44us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061459.714876:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789061459.714890:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789061459.714896:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779481600:12345-0@lo:400: 00000100:00100000:2.0:1789061459.714922:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779481600:12345-0@lo:400: Request processed in 26us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061459.714928:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789061459.714938:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789061459.714944:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779481984:12345-0@lo:400: 00000100:00100000:2.0:1789061459.714973:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779481984:12345-0@lo:400: Request processed in 29us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061459.714978:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789061459.715001:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789061459.715023:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a47c2b480 x1875966779481984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061459.715034:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779481984:0@lo:400: 00010000:00080000:2.0:1789061459.715060:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a47c2b800 x1875966779481600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061459.715070:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779481600:0@lo:400: 00010000:00080000:2.0:1789061459.715081:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a47c2ad80 x1875966779481728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061459.715090:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875966779481728:0@lo:400: 00000100:00100000:3.0:1789061459.716847:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779481472 00000100:00100000:3.0:1789061459.716862:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779481472 00000100:00100000:3.0:1789061459.716911:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789061459.716920:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3311:x1875966779481472:12345-0@lo:400: 00000100:00100000:3.0:1789061459.716993:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3311:x1875966779481472:12345-0@lo:400: Request processed in 74us (2643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061459.717000:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789061459.717035:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779481856 00000100:00100000:3.0:1789061459.717039:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779481856 00000100:00100000:3.0:1789061459.717070:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789061459.717077:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779481856:12345-0@lo:400: 00000100:00100000:3.0:1789061459.717108:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779481856:12345-0@lo:400: Request processed in 32us (2423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061459.717114:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789061459.719552:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061459.719611:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a47c29c00 x1875966779481856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061459.719628:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779481856:0@lo:400: 00000100:00100000:2.0:1789061459.719640:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779481472:0@lo:400: 00010000:00010000:3.0:1789061459.842368:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789061459.948693:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1789061460.227741:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779482240:0@lo:13: 00000100:00100000:0.0:1789061460.228319:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061460.228399:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779482240 00000100:00100000:1.0:1789061460.228408:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779482240 00000100:00100000:1.0:1789061460.228457:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789061460.228467:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779482240:12345-0@lo:13: 00002000:00000024:1.0:1789061460.228589:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061460.228651:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779482240:12345-0@lo:13: Request processed in 185us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061460.228657:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789061460.228847:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c2b4700 x1875966779482240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061460.228857:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789061460.228878:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779482240:0@lo:13: 00000100:00100000:0.0:1789061460.540526:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061460.543860:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758486144 00000100:00100000:2.0:1789061460.543878:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758486144 00000100:00100000:2.0:1789061460.543943:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:2.0:1789061460.543952:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1875966758486144:12345-192.168.204.54@tcp:250: 00010000:00080000:2.0:1789061460.543980:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 46360ae1-9af4-4026-b4fe-276273cba6e7@192.168.204.54@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:2.0:1789061460.544019:0:5844:0:(genops.c:1384:class_connect()) connect: client 46360ae1-9af4-4026-b4fe-276273cba6e7, cookie 0x427fa11dc4a9a6dd 00000100:00080000:2.0:1789061460.544234:0:5844:0:(import.c:65:import_set_state_nolock()) ffff971a4d7d6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789061460.544308:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+5:2352:x1875966758486144:12345-192.168.204.54@tcp:250: Request processed in 356us (3790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061460.544316:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:2.0:1789061460.571674:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061460.572596:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758486272 00000100:00100000:0.0:1789061460.572609:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758486272 00000100:00100000:0.0:1789061460.572673:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:0.0:1789061460.572685:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+5:5582:x1875966758486272:12345-192.168.204.54@tcp:101: 00010000:00010000:0.0:1789061460.572809:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061460.572830:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596d200/0x427fa11dc4a9a6e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca89f04 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061460.572862:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596d200/0x427fa11dc4a9a6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f04 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061460.572873:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596d200/0x427fa11dc4a9a6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f04 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061460.572882:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596d200, rc 0) 00000100:00100000:0.0:1789061460.572949:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+6:5582:x1875966758486272:12345-192.168.204.54@tcp:101: Request processed in 266us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061460.572971:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:3.0:1789061460.575892:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061460.575925:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758486400 00000100:00100000:2.0:1789061460.575936:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758486400 00000100:00100000:2.0:1789061460.575993:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:2.0:1789061460.576003:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+6:5582:x1875966758486400:12345-192.168.204.54@tcp:501: 00000100:00100000:2.0:1789061460.576363:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+6:5582:x1875966758486400:12345-192.168.204.54@tcp:501: Request processed in 359us (479us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789061460.576371:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:2.0:1789061460.581908:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061460.582029:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758486528 00000100:00100000:1.0:1789061460.582038:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758486528 00000100:00100000:1.0:1789061460.582136:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:1.0:1789061460.582145:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+6:5582:x1875966758486528:12345-192.168.204.54@tcp:101: 00010000:00010000:1.0:1789061460.582162:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061460.582182:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a6eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca89f0b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061460.582208:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f0b expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061460.582221:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f0b expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061460.582228:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4cc84c00, rc 0) 00000100:00100000:1.0:1789061460.582285:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+7:5582:x1875966758486528:12345-192.168.204.54@tcp:101: Request processed in 140us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061460.582292:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:0.0:1789061460.592750:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061460.592789:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758486656 00000100:00100000:0.0:1789061460.592801:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758486656 00000100:00100000:0.0:1789061460.592849:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:0.0:1789061460.592860:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+7:5582:x1875966758486656:12345-192.168.204.54@tcp:501: 00000100:00100000:0.0:1789061460.593088:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+8:5582:x1875966758486656:12345-192.168.204.54@tcp:501: Request processed in 229us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061460.593097:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:0.0:1789061460.597142:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061460.597173:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758486784 00000100:00100000:0.0:1789061460.597182:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758486784 00000100:00100000:0.0:1789061460.597222:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:0.0:1789061460.597232:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+8:5582:x1875966758486784:12345-192.168.204.54@tcp:503: 00000100:00100000:0.0:1789061460.599050:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+8:5582:x1875966758486784:12345-192.168.204.54@tcp:503: Request processed in 1809us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061460.599062:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:0.0:1789061460.603176:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061460.603267:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758486912 00000100:00100000:2.0:1789061460.603278:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758486912 00000100:00100000:2.0:1789061460.603322:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:2.0:1789061460.603332:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+8:5600:x1875966758486912:12345-192.168.204.54@tcp:502: 00000100:00100000:2.0:1789061460.603856:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+8:5600:x1875966758486912:12345-192.168.204.54@tcp:502: Request processed in 524us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061460.603865:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:0.0:1789061460.648877:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061460.649007:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758487040 00000100:00100000:3.0:1789061460.649019:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758487040 00000100:00100000:3.0:1789061460.649076:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:3.0:1789061460.649086:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+8:5600:x1875966758487040:12345-192.168.204.54@tcp:502: 00000100:00100000:3.0:1789061460.649335:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+8:5600:x1875966758487040:12345-192.168.204.54@tcp:502: Request processed in 250us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061460.649343:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:1.0:1789061460.665237:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061460.666396:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758487168 00000100:00100000:2.0:1789061460.666408:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758487168 00000100:00100000:2.0:1789061460.667477:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:2.0:1789061460.667508:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+8:5582:x1875966758487168:12345-192.168.204.54@tcp:101: 00010000:00010000:2.0:1789061460.667528:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061460.667557:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63ea00/0x427fa11dc4a9a6f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca89f35 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061460.667587:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63ea00/0x427fa11dc4a9a6f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f35 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061460.667598:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63ea00/0x427fa11dc4a9a6f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f35 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061460.667608:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63ea00, rc 0) 00000100:00100000:2.0:1789061460.667683:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+9:5582:x1875966758487168:12345-192.168.204.54@tcp:101: Request processed in 195us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061460.667691:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:0.0:1789061460.671205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061460.671238:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758487296 00000100:00100000:3.0:1789061460.671248:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758487296 00000100:00100000:3.0:1789061460.671302:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:3.0:1789061460.671313:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+9:5582:x1875966758487296:12345-192.168.204.54@tcp:256: 20000000:01000000:3.0:1789061460.671337:0:5843:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789061460.671357:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789061460.671361:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789061460.671365:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789061460.671367:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789061460.675907:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+9:5582:x1875966758487296:12345-192.168.204.54@tcp:256: Request processed in 4583us (4698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061460.675923:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:1.0:1789061460.688422:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061460.688511:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758487424 00000100:00100000:0.0:1789061460.688524:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758487424 00000100:00100000:0.0:1789061460.688591:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:0.0:1789061460.688602:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+9:5582:x1875966758487424:12345-192.168.204.54@tcp:101: 00010000:00010000:0.0:1789061460.688622:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061460.688651:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596c200/0x427fa11dc4a9a6f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca89f3c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061460.688696:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596c200/0x427fa11dc4a9a6f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f3c expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061460.688708:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596c200/0x427fa11dc4a9a6f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f3c expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061460.688719:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c200, rc 0) 00000100:00100000:0.0:1789061460.688782:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5582:x1875966758487424:12345-192.168.204.54@tcp:101: Request processed in 182us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061460.688789:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:2.0:1789061460.698167:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061460.698436:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758487552 00000100:00100000:1.0:1789061460.698447:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758487552 00000100:00100000:1.0:1789061460.698857:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:1.0:1789061460.698869:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5582:x1875966758487552:12345-192.168.204.54@tcp:501: 00000100:00100000:1.0:1789061460.699238:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5582:x1875966758487552:12345-192.168.204.54@tcp:501: Request processed in 371us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061460.699248:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:1.0:1789061460.702079:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061460.702353:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758487680 00000100:00100000:0.0:1789061460.702366:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758487680 00000100:00100000:0.0:1789061460.702431:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:0.0:1789061460.702441:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5582:x1875966758487680:12345-192.168.204.54@tcp:503: 00000100:00100000:1.0:1789061460.703522:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5582:x1875966758487680:12345-192.168.204.54@tcp:503: Request processed in 1077us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061460.703533:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:0.0:1789061460.709055:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061460.709088:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758487808 00000100:00100000:3.0:1789061460.709099:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758487808 00000100:00100000:3.0:1789061460.709157:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:3.0:1789061460.709168:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5604:x1875966758487808:12345-192.168.204.54@tcp:502: 00000100:00100000:3.0:1789061460.709528:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5604:x1875966758487808:12345-192.168.204.54@tcp:502: Request processed in 360us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061460.709537:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:3.0:1789061460.722346:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061460.722523:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758487936 00000100:00100000:1.0:1789061460.722534:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758487936 00000100:00100000:1.0:1789061460.722596:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:1.0:1789061460.722606:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5604:x1875966758487936:12345-192.168.204.54@tcp:502: 00000100:00100000:1.0:1789061460.722869:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5604:x1875966758487936:12345-192.168.204.54@tcp:502: Request processed in 264us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061460.722878:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:1.0:1789061460.728042:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061460.728136:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758488064 00000100:00100000:3.0:1789061460.728147:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758488064 00000100:00100000:3.0:1789061460.728194:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1789061460.728202:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875966758488064:12345-192.168.204.54@tcp:38: 00010000:00080000:3.0:1789061460.728235:0:5853:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1789061460.728287:0:5853:0:(genops.c:1384:class_connect()) connect: client 778edf7b-5a2f-4729-afd3-c88291fdad66, cookie 0x427fa11dc4a9a700 00000004:00100000:3.0:1789061460.728317:0:5853:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789061460.728323:0:5853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789061460.766270:0:5853:0:(import.c:65:import_set_state_nolock()) ffff971a76118800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061460.766354:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2352:x1875966758488064:12345-192.168.204.54@tcp:38: Request processed in 38149us (38321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061460.766387:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00010000:00010000:2.0:1789061460.864175:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061461.774858:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061461.775209:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758488192 00000100:00100000:2.0:1789061461.775244:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758488192 00000100:00100000:2.0:1789061461.775330:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1789061461.775342:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:0:x1875966758488192:12345-192.168.204.54@tcp:41: 00000004:00000024:2.0:1789061461.775395:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789061461.775510:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:0:x1875966758488192:12345-192.168.204.54@tcp:41: Request processed in 146us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061461.775519:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00080000:0.0:1789061461.776663:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061461.780130:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061461.780241:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758488320 00000100:00100000:3.0:1789061461.780252:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758488320 00000100:00100000:3.0:1789061461.780314:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1789061461.780326:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:5582:x1875966758488320:12345-192.168.204.54@tcp:41: 00000004:00000024:3.0:1789061461.780378:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789061461.781451:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:5582:x1875966758488320:12345-192.168.204.54@tcp:41: Request processed in 1121us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061461.781540:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1789061461.784303:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061461.784423:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758488448 00000100:00100000:1.0:1789061461.784434:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758488448 00000100:00100000:1.0:1789061461.784531:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1789061461.784542:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:5582:x1875966758488448:12345-192.168.204.54@tcp:40: 00000100:00100000:1.0:1789061461.784657:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:5582:x1875966758488448:12345-192.168.204.54@tcp:40: Request processed in 118us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061461.784664:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789061461.788451:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061461.788529:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061461.788569:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061461.788625:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061461.788733:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758488832 00000100:00100000:2.0:1789061461.788745:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758488832 00000100:00100000:2.0:1789061461.788809:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1789061461.788820:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:5582:x1875966758488832:12345-192.168.204.54@tcp:33: 00000100:00100000:3.0:1789061461.789146:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758488576 00000100:00100000:3.0:1789061461.789152:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758488576 00000100:00100000:3.0:1789061461.789182:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758488704 00000100:00100000:3.0:1789061461.789186:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758488704 00000100:00100000:3.0:1789061461.789199:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1789061461.789205:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875966758488576:12345-192.168.204.54@tcp:8: 00010000:00080000:3.0:1789061461.789243:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:3.0:1789061461.789276:0:6699:0:(genops.c:1384:class_connect()) connect: client 778edf7b-5a2f-4729-afd3-c88291fdad66, cookie 0x427fa11dc4a9a707 00002000:00100000:3.0:1789061461.789288:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 778edf7b-5a2f-4729-afd3-c88291fdad66/ffff971a76119000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789061461.789316:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789061461.790041:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758488960 00000100:00100000:0.0:1789061461.790051:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758488960 00000100:00100000:0.0:1789061461.790086:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:0.0:1789061461.790094:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2354:x1875966758488960:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1789061461.790162:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2354:x1875966758488960:12345-192.168.204.54@tcp:400: Request processed in 68us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061461.790182:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00002000:00080000:3.0:1789061461.792160:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789061461.792206:0:6699:0:(import.c:65:import_set_state_nolock()) ffff971a7611b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061461.792656:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2352:x1875966758488576:12345-192.168.204.54@tcp:8: Request processed in 3445us (4213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061461.792692:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1789061461.792724:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1789061461.792731:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875966758488704:12345-192.168.204.54@tcp:8: 00010000:00080000:3.0:1789061461.792755:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:3.0:1789061461.792779:0:6699:0:(genops.c:1384:class_connect()) connect: client 778edf7b-5a2f-4729-afd3-c88291fdad66, cookie 0x427fa11dc4a9a70e 00002000:00100000:3.0:1789061461.792789:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 778edf7b-5a2f-4729-afd3-c88291fdad66/ffff971a7611f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789061461.792809:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789061461.793121:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789061461.793141:0:6699:0:(import.c:65:import_set_state_nolock()) ffff971a7611a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061461.793170:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2352:x1875966758488704:12345-192.168.204.54@tcp:8: Request processed in 437us (4640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061461.793176:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000004:00080000:2.0:1789061461.818889:0:5854:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 29983us 00000004:00200000:0.0:1789061461.846594:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789061461.846766:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:5582:x1875966758488832:12345-192.168.204.54@tcp:33: Request processed in 57941us (58188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061461.846781:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00010000:00010000:3.0:1789061461.885784:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061462.091637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061462.091852:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758489088 00000100:00100000:3.0:1789061462.091866:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758489088 00000100:00100000:3.0:1789061462.091948:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1789061462.091961:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:5622:x1875966758489088:12345-192.168.204.54@tcp:101: 00010000:00010000:3.0:1789061462.091990:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061462.099381:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca89f66 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061462.099527:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a71c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061462.099544:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061462.099576:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061462.099615:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789061462.099619:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789061462.099635:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061462.099667:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f66 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061462.099691:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a71c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f66 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061462.099699:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636300) 00010000:00010000:3.0:1789061462.099702:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789061462.099705:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476400, rc 0) 00000100:00100000:3.0:1789061462.099789:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:5622:x1875966758489088:12345-192.168.204.54@tcp:101: Request processed in 7830us (8169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061462.099798:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1789061462.781904:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789061462.781946:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779482368:0@lo:13: 00000100:00100000:3.0:1789061462.782046:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061462.782288:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779482368 00000100:00100000:1.0:1789061462.782298:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779482368 00000100:00100000:1.0:1789061462.782443:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789061462.782456:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779482368:12345-0@lo:13: 00002000:00000024:1.0:1789061462.782513:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061462.782588:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779482368:12345-0@lo:13: Request processed in 135us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061462.782596:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789061462.782802:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971945c92680 x1875966779482368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061462.782825:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779482368:0@lo:13: 00000100:00080000:0.0:1789061462.783138:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789061462.911138:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061463.933951:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061464.421004:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061464.421810:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758489216 00000100:00100000:2.0:1789061464.421827:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758489216 00000100:00100000:2.0:1789061464.421937:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1789061464.421951:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+7:5674:x1875966758489216:12345-192.168.204.54@tcp:41: 00000004:00000024:2.0:1789061464.422015:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789061464.422115:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+7:5674:x1875966758489216:12345-192.168.204.54@tcp:41: Request processed in 167us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061464.422122:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00080000:0.0:1789061464.422208:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061464.429763:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061464.430473:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758489344 00000100:00100000:2.0:1789061464.430524:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758489344 00000100:00100000:2.0:1789061464.430642:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1789061464.430657:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778edf7b-5a2f-4729-afd3-c88291fdad66+6:5674:x1875966758489344:12345-192.168.204.54@tcp:13: 00002000:00000024:2.0:1789061464.430738:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061464.430841:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778edf7b-5a2f-4729-afd3-c88291fdad66+6:5674:x1875966758489344:12345-192.168.204.54@tcp:13: Request processed in 188us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061464.430848:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00080000:0.0:1789061464.431542:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061464.442222:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061464.447013:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758489472 00000100:00100000:2.0:1789061464.447038:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758489472 00000100:00100000:2.0:1789061464.447164:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1789061464.447178:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778edf7b-5a2f-4729-afd3-c88291fdad66+6:5674:x1875966758489472:12345-192.168.204.54@tcp:13: 00002000:00000024:2.0:1789061464.447234:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061464.447349:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778edf7b-5a2f-4729-afd3-c88291fdad66+6:5674:x1875966758489472:12345-192.168.204.54@tcp:13: Request processed in 174us (5143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061464.447357:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00080000:0.0:1789061464.447902:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061464.829983:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875966779482752:0@lo:400: 00000100:00100000:0.0:1789061464.830147:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779482880:0@lo:400: 00000100:00100000:1.0:1789061464.830235:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779482624:0@lo:400: 00000100:00100000:2.0:1789061464.830308:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779482496:0@lo:400: 00000100:00100000:0.0:1789061464.835144:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061464.835311:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779482880 00000100:00100000:0.0:1789061464.835324:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779482880 00000100:00100000:0.0:1789061464.835422:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789061464.835434:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779482880:12345-0@lo:400: 00000100:00100000:0.0:1789061464.835547:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779482880:12345-0@lo:400: Request processed in 116us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061464.835555:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789061464.835586:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789061464.835626:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75cb1500 x1875966779482880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061464.835643:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779482880:0@lo:400: 00000100:00100000:3.0:1789061464.849815:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061464.849990:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061464.850048:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779483136:0@lo:400: 00000100:00100000:1.0:1789061464.850092:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061464.850231:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779482752 00000100:00100000:3.0:1789061464.850242:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779482752 00000100:00100000:3.0:1789061464.850390:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779482624 00000100:00100000:3.0:1789061464.850394:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779482624 00000100:00100000:3.0:1789061464.850415:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789061464.850425:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875966779482752:12345-0@lo:400: 00000100:00100000:3.0:1789061464.850520:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875966779482752:12345-0@lo:400: Request processed in 96us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061464.850529:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789061464.850549:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789061464.850556:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779482624:12345-0@lo:400: 00000100:00100000:3.0:1789061464.850589:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779482624:12345-0@lo:400: Request processed in 34us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061464.850596:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789061464.850645:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779482624:0@lo:400: 00000100:00100000:3.0:1789061464.851964:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875966779482752:0@lo:400: 00000100:00100000:3.0:1789061464.852098:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779483136 00000100:00100000:3.0:1789061464.852106:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779483136 00000100:00100000:2.0:1789061464.852713:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061464.852784:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779483008:0@lo:400: 00000100:00100000:2.0:1789061464.852826:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061464.852891:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779483008 00000100:00100000:2.0:1789061464.852898:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779483008 00000100:00100000:0.0:1789061464.852962:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779482496 00000100:00100000:0.0:1789061464.852967:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779482496 00000100:00100000:0.0:1789061464.853028:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789061464.853040:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3311:x1875966779482496:12345-0@lo:400: 00000100:00100000:0.0:1789061464.853124:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3311:x1875966779482496:12345-0@lo:400: Request processed in 87us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061464.853133:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789061464.853191:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779482496:0@lo:400: 00000100:00080000:1.0:1789061464.857695:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061464.858393:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061464.860312:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789061464.860332:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779483136:12345-0@lo:400: 00000100:00100000:3.0:1789061464.860476:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779483136:12345-0@lo:400: Request processed in 151us (10382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061464.860483:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789061464.860872:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75cb2a00 x1875966779483136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061464.860890:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779483136:0@lo:400: 00000100:00100000:2.0:1789061464.861096:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789061464.861105:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779483008:12345-0@lo:400: 00000100:00100000:2.0:1789061464.861166:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779483008:12345-0@lo:400: Request processed in 63us (8339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061464.861172:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789061464.861214:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779483008:0@lo:400: 00010000:00010000:2.0:1789061464.957821:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061465.341956:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779483264:0@lo:13: 00000100:00100000:3.0:1789061465.342056:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061465.342190:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779483264 00000100:00100000:2.0:1789061465.342200:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779483264 00000100:00100000:2.0:1789061465.342269:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789061465.342281:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779483264:12345-0@lo:13: 00002000:00000024:2.0:1789061465.342333:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061465.342406:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779483264:12345-0@lo:13: Request processed in 127us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061465.342414:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789061465.342588:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7cd2df80 x1875966779483264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061465.342612:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779483264:0@lo:13: 00000001:00100000:0.0:1789061465.414974:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 778edf7b-5a2f-4729-afd3-c88291fdad66 00000001:00100000:0.0:1789061465.968217:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 778edf7b-5a2f-4729-afd3-c88291fdad66 00010000:00010000:3.0:1789061465.983872:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789061466.422001:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 778edf7b-5a2f-4729-afd3-c88291fdad66 00000100:00100000:3.0:1789061466.853035:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061466.853090:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061466.853125:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061466.853156:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061466.853195:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758489856 00000100:00100000:3.0:1789061466.853208:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758489856 00000100:00100000:0.0:1789061466.853291:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758489984 00000100:00100000:0.0:1789061466.853297:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758489984 00000100:00100000:3.0:1789061466.853298:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1789061466.853315:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2354:x1875966758489856:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1789061466.853333:0:6701:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789061466.853346:0:6701:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789061466.853370:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758489728 00000100:00100000:0.0:1789061466.853374:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758489728 00000100:00100000:3.0:1789061466.853414:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2354:x1875966758489856:12345-192.168.204.54@tcp:400: Request processed in 102us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061466.853419:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1789061466.853430:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1789061466.853436:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2354:x1875966758489728:12345-192.168.204.54@tcp:400: 00000100:00100000:3.0:1789061466.853456:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789061466.853466:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2354:x1875966758489984:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1789061466.853480:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2354:x1875966758489728:12345-192.168.204.54@tcp:400: Request processed in 49us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061466.853520:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1789061466.853532:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2354:x1875966758489984:12345-192.168.204.54@tcp:400: Request processed in 67us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061466.853541:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00080000:0.0:1789061466.853544:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061466.853562:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061466.853565:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061466.854280:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758489600 00000100:00100000:1.0:1789061466.854290:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758489600 00000100:00100000:1.0:1789061466.854330:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:1.0:1789061466.854339:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2354:x1875966758489600:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1789061466.854411:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2354:x1875966758489600:12345-192.168.204.54@tcp:400: Request processed in 73us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061466.854419:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 130 00010000:00010000:2.0:1789061467.007098:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789061467.709190:0:8319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789061467.910934:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779483392:0@lo:13: 00000100:00100000:2.0:1789061467.911006:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061467.911825:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779483392 00000100:00100000:2.0:1789061467.911837:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779483392 00000100:00100000:2.0:1789061467.911900:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789061467.911910:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779483392:12345-0@lo:13: 00002000:00000024:2.0:1789061467.911949:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061467.912005:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779483392:12345-0@lo:13: Request processed in 97us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061467.912012:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789061467.912034:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061467.912069:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971945c92a00 x1875966779483392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061467.914369:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779483392:0@lo:13: 00010000:00010000:3.0:1789061468.029788:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061469.053865:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061469.954640:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779483520:0@lo:400: 00000100:00100000:2.0:1789061469.954711:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061469.954757:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779484032:0@lo:400: 00000100:00100000:2.0:1789061469.954794:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061469.954822:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789061469.954828:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779483904:0@lo:400: 00000100:00100000:2.0:1789061469.954849:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061469.954878:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779483648:0@lo:400: 00000100:00100000:2.0:1789061469.954898:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061469.954915:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779484160:0@lo:400: 00000100:00100000:2.0:1789061469.954951:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061469.955234:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061469.955241:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779483776:0@lo:400: 00000100:00100000:2.0:1789061469.955268:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061469.955313:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779483520 00000100:00100000:2.0:1789061469.955320:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779483520 00000100:00100000:2.0:1789061469.955362:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789061469.955370:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3311:x1875966779483520:12345-0@lo:400: 00000100:00100000:2.0:1789061469.956261:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3311:x1875966779483520:12345-0@lo:400: Request processed in 888us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061469.956271:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789061469.956333:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779484032 00000100:00100000:2.0:1789061469.956338:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779484032 00000100:00100000:2.0:1789061469.956370:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779483648 00000100:00100000:2.0:1789061469.956373:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779483648 00000100:00100000:2.0:1789061469.956386:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779483776 00000100:00100000:2.0:1789061469.956388:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779483776 00000100:00100000:2.0:1789061469.956402:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789061469.956661:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779484032:12345-0@lo:400: 00000100:00100000:2.0:1789061469.956713:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779484032:12345-0@lo:400: Request processed in 305us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061469.956713:0:5852:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789061469.956724:0:5852:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789061469.956731:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789061469.956746:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789061469.956753:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779483648:12345-0@lo:400: 00000100:00100000:2.0:1789061469.956799:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779483648:12345-0@lo:400: Request processed in 46us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061469.956804:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789061469.956816:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789061469.956822:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779483776:12345-0@lo:400: 00000100:00100000:1.0:1789061469.956840:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779483648:0@lo:400: 00000100:00100000:2.0:1789061469.956847:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779483776:12345-0@lo:400: Request processed in 27us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061469.956852:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789061469.956864:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779483776:0@lo:400: 00000100:00100000:2.0:1789061469.956871:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779483904 00000100:00100000:2.0:1789061469.956875:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779483904 00000100:00100000:2.0:1789061469.956908:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779484160 00000100:00100000:2.0:1789061469.956911:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779484160 00000100:00100000:1.0:1789061469.956925:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789061469.956933:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779483904:12345-0@lo:400: 00000100:00100000:1.0:1789061469.956972:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779483904:12345-0@lo:400: Request processed in 41us (2122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061469.956979:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789061469.956992:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789061469.956998:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779484160:12345-0@lo:400: 00000100:00100000:1.0:1789061469.957032:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779484160:12345-0@lo:400: Request processed in 34us (2080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061469.957037:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789061469.967899:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c605180 x1875966779484160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061469.967919:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779484160:0@lo:400: 00000100:00080000:0.0:1789061469.968665:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061469.968671:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789061469.968674:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789061469.968734:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c607800 x1875966779483904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061469.968745:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779483904:0@lo:400: 00000100:00100000:0.0:1789061469.968768:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779483520:0@lo:400: 00000100:00100000:0.0:1789061469.968781:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779484032:0@lo:400: 00010000:00010000:3.0:1789061470.079847:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061470.464329:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779484288:0@lo:13: 00000100:00100000:2.0:1789061470.464404:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061470.464929:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779484288 00000100:00100000:0.0:1789061470.464939:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779484288 00000100:00100000:2.0:1789061470.465072:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789061470.465083:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779484288:12345-0@lo:13: 00002000:00000024:2.0:1789061470.465117:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061470.465164:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779484288:12345-0@lo:13: Request processed in 84us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061470.465170:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789061470.465226:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7cd2e680 x1875966779484288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061470.465244:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779484288:0@lo:13: 00010000:00010000:3.0:1789061471.101930:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061471.972321:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061471.972363:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061471.972390:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061471.972417:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061471.972444:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758490112 00000100:00100000:3.0:1789061471.972454:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758490112 00000100:00100000:3.0:1789061471.972520:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:3.0:1789061471.972530:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2355:x1875966758490112:12345-192.168.204.54@tcp:400: 00000100:00100000:3.0:1789061471.972598:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2355:x1875966758490112:12345-192.168.204.54@tcp:400: Request processed in 70us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061471.972606:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:0.0:1789061471.972940:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758490240 00000100:00100000:0.0:1789061471.972946:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758490240 00000100:00100000:0.0:1789061471.973000:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1789061471.973009:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758490240:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1789061471.973048:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758490240:12345-192.168.204.54@tcp:400: Request processed in 41us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061471.973054:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1789061471.973075:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758490496 00000100:00100000:0.0:1789061471.973079:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758490496 00000100:00100000:0.0:1789061471.973105:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758490368 00000100:00100000:0.0:1789061471.973108:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758490368 00000100:00100000:0.0:1789061471.973130:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1789061471.973136:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758490496:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1789061471.973173:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758490496:12345-192.168.204.54@tcp:400: Request processed in 26us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061471.973180:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1789061471.973192:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789061471.973198:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758490368:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1789061471.973223:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758490368:12345-192.168.204.54@tcp:400: Request processed in 25us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061471.973229:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00080000:3.0:1789061471.974240:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789061471.974247:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061471.974251:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789061472.129681:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789061472.374808:0:8470:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9d1d7180 20000000:00000080:2.0:1789061472.374900:0:8470:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff971944c76800 uarg=0000000000000000 20000000:01000000:2.0:1789061472.375071:0:8470:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789061472.375073:0:8470:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789061472.375075:0:8470:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789061472.375080:0:8470:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789061472.375085:0:8470:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789061472.375101:0:8470:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789061472.375103:0:8470:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789061472.375523:0:8470:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789061472.375527:0:8470:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789061472.378941:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1789061472.379583:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1789061472.379636:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1789061472.379687:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1789061472.379705:0:8470:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789061472.379708:0:8470:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789061472.382390:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789061472.383481:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789061472.386719:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1789061472.386772:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1789061472.387419:0:8470:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789061472.387423:0:8470:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789061472.389051:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789061472.393188:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789061472.393622:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789061472.393655:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789061472.393671:0:8470:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789061472.393674:0:8470:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789061472.403358:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789061472.404132:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789061472.404392:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789061472.404435:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1789061472.404451:0:8470:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789061472.404471:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.404717:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9a620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a619 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.404736:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a643 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.404742:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a66d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.404748:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a67b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.404755:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a689 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.404762:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a40030600/0x427fa11dc4a9a6ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a6a5 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.404768:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a6cf expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.404776:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7596d200/0x427fa11dc4a9a6e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f04 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.404860:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a6eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f0b expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.404868:0:8470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.404909:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f0b expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.404935:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a6eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f0b expref: 9 pid: 5844 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061472.404950:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779484416:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061472.405056:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7596d200/0x427fa11dc4a9a6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f04 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.405064:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a7596d200/0x427fa11dc4a9a6e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f04 expref: 9 pid: 5845 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061472.405072:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779484544:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061472.405099:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a6cf expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.405107:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a6d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a6cf expref: 18 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061472.405115:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779484672:0@lo:104: 00000100:00100000:3.0:1789061472.405172:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789061472.405377:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a40030600/0x427fa11dc4a9a6ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a6a5 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.405385:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a40030600/0x427fa11dc4a9a6ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a6a5 expref: 18 pid: 5843 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061472.405394:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779484800:0@lo:104: 00000100:00100000:3.0:1789061472.405421:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789061472.407810:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a689 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.407828:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a690 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a689 expref: 18 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061472.407843:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779484928:0@lo:104: 00010000:00010000:3.0:1789061472.407896:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a67b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.407903:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a682 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a67b expref: 18 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061472.407912:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779485056:0@lo:104: 00010000:00010000:3.0:1789061472.407940:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a66d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.407947:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a674 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a66d expref: 18 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061472.407955:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779485184:0@lo:104: 00010000:00010000:3.0:1789061472.407979:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a643 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.407987:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a64a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a643 expref: 18 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061472.407995:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779485312:0@lo:104: 00010000:00010000:3.0:1789061472.408019:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9a620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a619 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.408042:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9a620 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a619 expref: 18 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061472.408050:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779485440:0@lo:104: 00000100:00100000:3.0:1789061472.408068:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2600 going to sleep for 11 seconds 00000100:00100000:3.0:1789061472.410943:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061472.410983:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061472.411074:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779484416:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061472.411088:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779484544:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061472.411454:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758490624 00000100:00100000:0.0:1789061472.411464:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758490624 00000100:00100000:2.0:1789061472.411551:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789061472.411585:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061472.411607:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061472.411617:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061472.411626:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061472.411635:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061472.411661:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779484672 00000100:00100000:2.0:1789061472.411665:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779484672 00010000:00010000:0.0:1789061472.411665:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a6eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f0b expref: 10 pid: 5844 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061472.411692:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779484800 00000100:00100000:2.0:1789061472.411695:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779484800 00000100:00100000:0.0:1789061472.411701:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758490752 00000100:00100000:0.0:1789061472.411704:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758490752 00000100:00100000:2.0:1789061472.411705:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779484928 00000100:00100000:2.0:1789061472.411707:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779484928 00000100:00100000:2.0:1789061472.411714:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779485056 00000100:00100000:2.0:1789061472.411716:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779485056 00010000:00010000:0.0:1789061472.411716:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7596d200/0x427fa11dc4a9a6e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f04 expref: 11 pid: 5845 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061472.411724:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779485184 00000100:00100000:2.0:1789061472.411726:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779485184 00000100:00100000:2.0:1789061472.411734:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779485312 00000100:00100000:0.0:1789061472.411735:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1789061472.411736:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779485312 00000100:00100000:0.0:1789061472.411743:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46360ae1-9af4-4026-b4fe-276273cba6e7+11:2356:x1875966758490624:12345-192.168.204.54@tcp:103: 00000100:00100000:2.0:1789061472.411744:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779485440 00000100:00100000:2.0:1789061472.411746:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779485440 00000100:00100000:2.0:1789061472.411756:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789061472.411756:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789061472.411761:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+9:8470:x1875966779484672:12345-0@lo:104: 00010000:00010000:0.0:1789061472.411762:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a6eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f0b expref: 11 pid: 5844 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.411773:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f0b expref: 11 pid: 5844 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.411778:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a6d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.411901:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789061472.411907:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+9:8470:x1875966779484672:12345-0@lo:104: Request processed in 146us (6735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061472.411926:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789061472.411946:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789061472.411952:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75df2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+8:8470:x1875966779484800:12345-0@lo:104: 00010000:00010000:2.0:1789061472.411961:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a6ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061472.411972:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1789061472.411981:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46360ae1-9af4-4026-b4fe-276273cba6e7+11:2356:x1875966758490752:12345-192.168.204.54@tcp:103: 00010000:00010000:3.0:1789061472.411989:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061472.411993:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789061472.411994:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7596d200/0x427fa11dc4a9a6e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f04 expref: 11 pid: 5845 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061472.411998:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75df2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+8:8470:x1875966779484800:12345-0@lo:104: Request processed in 47us (6577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061472.412003:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789061472.412048:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789061472.412054:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c606680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+7:8470:x1875966779484928:12345-0@lo:104: 00010000:00010000:2.0:1789061472.412061:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061472.412069:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:1.0:1789061472.412074:0:5834:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789061472.412080:0:5834:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1789061472.412088:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789061472.412092:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c606680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+7:8470:x1875966779484928:12345-0@lo:104: Request processed in 40us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061472.412098:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789061472.412110:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789061472.412116:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c604e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+6:8470:x1875966779485056:12345-0@lo:104: 00010000:00010000:2.0:1789061472.412129:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a682 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.412171:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789061472.412176:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c604e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+6:8470:x1875966779485056:12345-0@lo:104: Request processed in 62us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061472.412394:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1789061472.413994:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7596d200/0x427fa11dc4a9a6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f04 expref: 11 pid: 5845 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.414022:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7596d200/0x427fa11dc4a9a6e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f04 expref: 11 pid: 5845 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.414038:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061472.414117:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2356:x1875966758490752:12345-192.168.204.54@tcp:103: Request processed in 2135us (3131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061472.414127:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00010000:00010000:0.0:1789061472.414455:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4cc84c00/0x427fa11dc4a9a6eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f0b expref: 9 pid: 5844 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.414468:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061472.414591:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46360ae1-9af4-4026-b4fe-276273cba6e7+8:2356:x1875966758490624:12345-192.168.204.54@tcp:103: Request processed in 2847us (3658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061472.414615:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00010000:00010000:0.0:1789061472.414707:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789061472.414715:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a6d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.414724:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40031e00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061472.414729:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a6d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.414739:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a6d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061472.414746:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a6d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061472.414752:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789061472.414899:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789061472.414916:0:8475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c605500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:24dfd7ac-7455-4043-9449-a564380782df+5:8470:x1875966779485184:12345-0@lo:104: 00010000:00010000:1.0:1789061472.414929:0:8475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a674 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061472.414996:0:8475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789061472.415001:0:8475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c605500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:24dfd7ac-7455-4043-9449-a564380782df+5:8470:x1875966779485184:12345-0@lo:104: Request processed in 92us (3383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061472.415006:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789061472.415026:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789061472.415032:0:8475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:24dfd7ac-7455-4043-9449-a564380782df+4:8470:x1875966779485312:12345-0@lo:104: 00010000:00010000:1.0:1789061472.415039:0:8475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a64a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061472.415065:0:8475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789061472.415069:0:8475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:24dfd7ac-7455-4043-9449-a564380782df+4:8470:x1875966779485312:12345-0@lo:104: Request processed in 38us (3442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061472.415074:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789061472.415085:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789061472.415089:0:8475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:24dfd7ac-7455-4043-9449-a564380782df+3:8470:x1875966779485440:12345-0@lo:104: 00010000:00010000:1.0:1789061472.415096:0:8475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a620 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061472.415118:0:8475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789061472.415130:0:8475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:24dfd7ac-7455-4043-9449-a564380782df+3:8470:x1875966779485440:12345-0@lo:104: Request processed in 40us (3493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061472.415136:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789061472.416943:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a6d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.416958:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061472.416986:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a6d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.416994:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a40031e00/0x427fa11dc4a9a6cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a6d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061472.417009:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779485568:0@lo:103: 00010000:00010000:0.0:1789061472.417022:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789061472.417027:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a6ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.417051:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41477200 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061472.417055:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a6ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.417064:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a6ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061472.417070:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a6ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061472.417076:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789061472.417080:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061472.417100:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a6ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.417106:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061472.417111:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a6ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.417117:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a41477200/0x427fa11dc4a9a6a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a6ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061472.417126:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1789061472.417126:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789061472.417129:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061472.417132:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779485696:0@lo:103: 00010000:00010000:0.0:1789061472.417135:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061472.417138:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061472.417151:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061472.417168:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061472.417176:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061472.417181:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789061472.417195:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.417201:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789061472.417262:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779485568 00000100:00100000:2.0:1789061472.417271:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779485568 00010000:00010000:2.0:1789061472.417302:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a6d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a6cf expref: 19 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061472.417326:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779485696 00000100:00100000:2.0:1789061472.417329:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779485696 00010000:00010000:2.0:1789061472.417341:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a40030600/0x427fa11dc4a9a6ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a6a5 expref: 20 pid: 5843 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061472.417360:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789061472.417367:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c604000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+20:3310:x1875966779485568:12345-0@lo:103: 00010000:00010000:2.0:1789061472.417380:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061472.417385:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a6d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a6cf expref: 20 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.417396:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a6d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a6cf expref: 20 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.417421:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061472.417459:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c604000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+20:3310:x1875966779485568:12345-0@lo:103: Request processed in 93us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061472.417466:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789061472.417517:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789061472.417525:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+19:3310:x1875966779485696:12345-0@lo:103: 00010000:00010000:2.0:1789061472.417533:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061472.417538:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a40030600/0x427fa11dc4a9a6ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a6a5 expref: 19 pid: 5843 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.417546:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a40030600/0x427fa11dc4a9a6ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a6a5 expref: 19 pid: 5843 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.417556:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061472.417579:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+19:3310:x1875966779485696:12345-0@lo:103: Request processed in 55us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061472.417584:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789061472.417624:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779485696:0@lo:103: 00000100:00100000:2.0:1789061472.417634:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779485568:0@lo:103: 00010000:00010000:1.0:1789061472.418628:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789061472.418942:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a6d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a6cf expref: 18 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061472.418971:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779484672:0@lo:104: 00010000:00010000:3.0:1789061472.418986:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a40030600/0x427fa11dc4a9a6ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a6a5 expref: 17 pid: 5843 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061472.418994:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779484800:0@lo:104: 00000100:00100000:3.0:1789061472.419005:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779484928:0@lo:104: 00000100:00100000:3.0:1789061472.419013:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779485056:0@lo:104: 00000100:00100000:3.0:1789061472.419021:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779485184:0@lo:104: 00000100:00100000:3.0:1789061472.419030:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779485312:0@lo:104: 00000100:00100000:3.0:1789061472.419037:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1875966779485440:0@lo:104: 00010000:00010000:3.0:1789061472.419072:0:8470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.419187:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.419197:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a40030c00/0x427fa11dc4a9a689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.419217:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789061472.419221:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a674 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061472.419276:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779485824:0@lo:103: 00000100:00100000:2.0:1789061472.419328:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061472.419374:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779485824 00000100:00100000:2.0:1789061472.419382:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779485824 00010000:00010000:2.0:1789061472.419409:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a690 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a689 expref: 17 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061472.419432:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789061472.419448:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c605c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+17:3312:x1875966779485824:12345-0@lo:103: 00010000:00010000:2.0:1789061472.419460:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061472.419465:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a690 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a689 expref: 17 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.419475:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a689 expref: 17 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.419509:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a689 expref: 17 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.419520:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061472.419553:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c605c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+16:3312:x1875966779485824:12345-0@lo:103: Request processed in 106us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061472.419559:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789061472.419590:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779485824:0@lo:103: 00010000:00010000:1.0:1789061472.419676:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789061472.419719:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40031400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061472.419724:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a674 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.419732:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a674 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061472.419740:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a674 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061472.419753:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789061472.419964:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a674 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.419973:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061472.419995:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a674 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.420002:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a40031400/0x427fa11dc4a9a66d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a674 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.420014:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061472.420017:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a620 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.420022:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40031800 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061472.420025:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a620 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.420032:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a620 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061472.420038:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a620 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061472.420042:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789061472.420076:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779485952:0@lo:103: 00000100:00100000:3.0:1789061472.420109:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061472.420457:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a620 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.420464:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789061472.420531:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779485952 00010000:00010000:3.0:1789061472.420532:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a682 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.420538:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f600 already unused, calling callback (ffffffffc1a5fc20) 00000100:00100000:2.0:1789061472.420538:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779485952 10000000:00010000:3.0:1789061472.420541:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a682 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.420548:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a682 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061472.420554:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a682 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.420558:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a674 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a66d expref: 16 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061472.420566:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789061472.420580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789061472.420586:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+16:3313:x1875966779485952:12345-0@lo:103: 00010000:00010000:2.0:1789061472.420595:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061472.420600:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a674 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a66d expref: 16 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.420607:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a620 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.420610:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a66d expref: 16 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.420614:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a40031800/0x427fa11dc4a9a619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a620 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.420624:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061472.420626:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061472.420628:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061472.420631:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a674 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a66d expref: 16 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061472.420634:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1789061472.420642:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061472.420644:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779486080:0@lo:103: 00000100:00100000:0.0:1789061472.420671:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061472.420678:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+15:3313:x1875966779485952:12345-0@lo:103: Request processed in 93us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061472.420685:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789061472.420698:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779486080 00000100:00100000:2.0:1789061472.420701:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779486080 00010000:00010000:2.0:1789061472.420713:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9a620 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a619 expref: 15 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061472.420723:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779485952:0@lo:103: 00000100:00100000:2.0:1789061472.420728:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789061472.420733:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+15:3311:x1875966779486080:12345-0@lo:103: 00010000:00010000:2.0:1789061472.420739:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061472.420743:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9a620 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a619 expref: 15 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.420751:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9a620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a619 expref: 15 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.420761:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9a620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a619 expref: 15 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.420769:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061472.420805:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+14:3311:x1875966779486080:12345-0@lo:103: Request processed in 70us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061472.420810:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789061472.420915:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779486080:0@lo:103: 00010000:00010000:3.0:1789061472.421111:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a682 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.421118:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789061472.421167:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779486208:0@lo:103: 00000100:00100000:0.0:1789061472.421211:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789061472.421315:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a682 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.421323:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4f63f600/0x427fa11dc4a9a67b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a682 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061472.421334:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061472.421335:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061472.421337:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061472.421822:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061472.421825:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061472.421826:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061472.421908:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a64a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061472.421917:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030800 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061472.421920:0:8476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a64a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061472.421927:0:8476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a64a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061472.421934:0:8476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a64a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061472.421939:0:8476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789061472.421964:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779486208 00010000:00010000:1.0:1789061472.421969:0:8476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a64a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061472.421975:0:8476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789061472.421977:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779486208 00010000:00010000:1.0:1789061472.421987:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a64a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061472.421992:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a40030800/0x427fa11dc4a9a643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a64a expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.421996:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a682 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a67b expref: 14 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061472.422008:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061472.422010:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061472.422016:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061472.422017:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789061472.422023:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+14:3311:x1875966779486208:12345-0@lo:103: 00010000:00010000:2.0:1789061472.422031:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061472.422035:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a682 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a67b expref: 14 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.422044:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a67b expref: 14 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.422056:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a682 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a67b expref: 14 pid: 5845 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.422067:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061472.422098:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+13:3311:x1875966779486208:12345-0@lo:103: Request processed in 75us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061472.422104:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789061472.422147:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779486208:0@lo:103: 00000100:00100000:0.0:1789061472.422180:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061472.422188:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779486336:0@lo:103: 00000100:00100000:0.0:1789061472.422398:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061472.422443:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779486336 00000100:00100000:0.0:1789061472.422447:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779486336 00010000:00010000:0.0:1789061472.422465:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a64a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a643 expref: 13 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061472.422521:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789061472.422528:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+13:3313:x1875966779486336:12345-0@lo:103: 00010000:00010000:0.0:1789061472.422546:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061472.422552:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a64a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a643 expref: 13 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.422561:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a643 expref: 13 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.422571:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a64a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a643 expref: 13 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.422583:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.422591:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.422606:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.422614:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.422620:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.422628:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.422633:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41477800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061472.422637:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.422656:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.422679:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061472.422688:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061472.422717:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+12:3313:x1875966779486336:12345-0@lo:103: Request processed in 190us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061472.422723:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789061472.422751:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779486336:0@lo:103: 00010000:00010000:2.0:1789061472.422903:0:8470:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.422912:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061472.422918:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a723 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061473.021776:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061473.021808:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779486464:0@lo:13: 00000100:00100000:2.0:1789061473.021898:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061473.022022:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779486464 00000100:00100000:3.0:1789061473.022033:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779486464 00000100:00080000:2.0:1789061473.022101:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061473.022113:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789061473.022124:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779486464:12345-0@lo:13: 00002000:00000024:3.0:1789061473.022178:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061473.022249:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779486464:12345-0@lo:13: Request processed in 127us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061473.022257:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789061473.022284:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971945c92a00 x1875966779486464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061473.022304:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779486464:0@lo:13: 00010000:00010000:0.0:1789061473.152412:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789061473.981617:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789061473.981625:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff971a75aff800 from 39 10000000:01000000:1.0:1789061473.981631:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789061473.981684:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061473.981696:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061473.981707:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061473.981869:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779486592:0@lo:101: 00000100:00100000:1.0:1789061473.982032:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061473.982204:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47cbd780 going to sleep for 11 seconds 00000100:00100000:0.0:1789061473.992751:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779486592 00000100:00100000:0.0:1789061473.992768:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779486592 00000100:00100000:0.0:1789061473.992840:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789061473.992852:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+12:5848:x1875966779486592:12345-0@lo:101: 00010000:00010000:0.0:1789061473.992871:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061473.992892:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596d400/0x427fa11dc4a9a731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a72a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061473.992922:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596d400/0x427fa11dc4a9a731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a72a expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061473.992934:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596d400/0x427fa11dc4a9a731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a72a expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061473.992943:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596d400, rc 0) 00000100:00100000:0.0:1789061473.993020:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:5848:x1875966779486592:12345-0@lo:101: Request processed in 171us (10988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061473.993041:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789061473.993242:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779486592:0@lo:101: 00010000:00010000:1.0:1789061473.993261:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061473.993270:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061473.993340:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779486720:0@lo:501: 00000100:00100000:1.0:1789061473.993377:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061473.993575:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47cbd780 going to sleep for 11 seconds 00000100:00100000:3.0:1789061473.993639:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779486720 00000100:00100000:3.0:1789061473.993644:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779486720 00000100:00100000:3.0:1789061473.993685:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789061473.993693:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+13:5848:x1875966779486720:12345-0@lo:501: 00000100:00100000:3.0:1789061473.994294:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+13:5848:x1875966779486720:12345-0@lo:501: Request processed in 601us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061473.994303:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789061473.995840:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779486720:0@lo:501: 00000100:00100000:1.0:1789061473.995904:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779486848:0@lo:503: 00000100:00100000:1.0:1789061473.996147:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061473.996261:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47cbd780 going to sleep for 11 seconds 00000100:00100000:0.0:1789061473.996346:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779486848 00000100:00100000:0.0:1789061473.996354:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779486848 00000100:00100000:0.0:1789061473.996405:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789061473.996423:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:5848:x1875966779486848:12345-0@lo:503: 00000100:00100000:0.0:1789061473.996644:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:5848:x1875966779486848:12345-0@lo:503: Request processed in 231us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061473.996652:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789061473.997910:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779486848:0@lo:503: 00000100:00100000:1.0:1789061473.998799:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8489:1875966779486976:0@lo:502: 00000100:00100000:1.0:1789061473.998869:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061473.999063:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47cbdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789061473.999155:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779486976 00000100:00100000:3.0:1789061473.999162:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779486976 00000100:00100000:3.0:1789061473.999223:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789061473.999232:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+13:8489:x1875966779486976:12345-0@lo:502: 00000100:00100000:3.0:1789061473.999534:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+13:8489:x1875966779486976:12345-0@lo:502: Request processed in 302us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061473.999542:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789061473.999798:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8489:1875966779486976:0@lo:502: 00000100:00100000:2.0:1789061473.999851:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c604a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8489:1875966779487104:0@lo:502: 00000100:00100000:2.0:1789061473.999886:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061473.999913:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64ce6540 going to sleep for 11 seconds 00000100:00100000:1.0:1789061474.000107:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779487104 00000100:00100000:1.0:1789061474.000112:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779487104 00000100:00100000:1.0:1789061474.000150:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789061474.000158:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:8489:x1875966779487104:12345-0@lo:502: 00000100:00100000:1.0:1789061474.000855:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+13:8489:x1875966779487104:12345-0@lo:502: Request processed in 695us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061474.000863:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789061474.002720:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c604a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8489:1875966779487104:0@lo:502: 00000040:00080000:2.0:1789061474.002786:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789061474.003185:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789061474.003213:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789061474.003223:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.003235:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061474.003247:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789061474.003249:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789061474.003252:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789061474.003289:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.003299:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.003319:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061474.003349:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779487232:0@lo:101: 00000100:00100000:1.0:1789061474.003409:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061474.003454:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47cbd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789061474.003738:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779487232 00000100:00100000:3.0:1789061474.003882:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779487232 00000100:00100000:3.0:1789061474.003958:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789061474.003968:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+13:5848:x1875966779487232:12345-0@lo:101: 00010000:00010000:3.0:1789061474.003982:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061474.003995:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a73f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a738 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061474.004019:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a73f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a738 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061474.004031:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a73f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a738 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061474.004040:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41477e00, rc 0) 00000100:00100000:3.0:1789061474.004091:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779487232:12345-0@lo:101: Request processed in 125us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061474.004097:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789061474.004591:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779487232:0@lo:101: 00010000:00010000:2.0:1789061474.004608:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061474.004619:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061474.004685:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c604a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779487360:0@lo:501: 00000100:00100000:2.0:1789061474.004722:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061474.005057:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64ce6540 going to sleep for 11 seconds 00000100:00100000:0.0:1789061474.014254:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779487360 00000100:00100000:0.0:1789061474.014271:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779487360 00000100:00100000:1.0:1789061474.014625:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789061474.014637:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779487360:12345-0@lo:501: 00000100:00100000:1.0:1789061474.015022:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779487360:12345-0@lo:501: Request processed in 386us (10298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061474.015030:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789061474.015529:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c604a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779487360:0@lo:501: 00000100:00100000:2.0:1789061474.015585:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c604a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779487488:0@lo:503: 00000100:00100000:2.0:1789061474.015636:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061474.015676:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64ce6540 going to sleep for 11 seconds 00000100:00100000:1.0:1789061474.017352:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779487488 00000100:00100000:1.0:1789061474.017367:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779487488 00000100:00100000:1.0:1789061474.017435:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789061474.017444:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779487488:12345-0@lo:503: 00000100:00100000:1.0:1789061474.017719:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779487488:12345-0@lo:503: Request processed in 275us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061474.017734:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789061474.018142:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c604a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779487488:0@lo:503: 00000100:00100000:0.0:1789061474.018648:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8490:1875966779487616:0@lo:502: 00000100:00100000:0.0:1789061474.018708:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061474.018760:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061474.018865:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779487616 00000100:00100000:2.0:1789061474.018871:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779487616 00000100:00100000:2.0:1789061474.018914:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789061474.018932:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+14:8490:x1875966779487616:12345-0@lo:502: 00000100:00100000:2.0:1789061474.019098:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+14:8490:x1875966779487616:12345-0@lo:502: Request processed in 167us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061474.019106:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789061474.019629:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8490:1875966779487616:0@lo:502: 00000020:01000000:0.0:1789061474.019656:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061474.019665:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061474.019667:0:8490:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789061474.019672:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789061474.019696:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8490:1875966779487744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061474.019729:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061474.019765:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061474.019892:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779487744 00000100:00100000:2.0:1789061474.019898:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779487744 00000100:00100000:2.0:1789061474.019939:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789061474.019947:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+14:8490:x1875966779487744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061474.020082:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+14:8490:x1875966779487744:12345-0@lo:502:llog_process_th.0 Request processed in 135us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061474.020089:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789061474.020695:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8490:1875966779487744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789061474.020716:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061474.020721:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061474.020723:0:8490:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789061474.020743:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789061474.021054:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789061474.021072:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789061474.021081:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061474.021094:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061474.021104:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789061474.021106:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff971a7618e800 from 39 10000000:01000000:2.0:1789061474.021109:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789061474.021151:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061474.021170:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061474.021249:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061474.021268:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779487872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061474.021306:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061474.021394:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64ce6180 going to sleep for 11 seconds 00000100:00100000:0.0:1789061474.021963:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779487872 00000100:00100000:0.0:1789061474.021971:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779487872 00000100:00100000:0.0:1789061474.022008:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789061474.022015:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+14:5848:x1875966779487872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061474.022027:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061474.022039:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596c800/0x427fa11dc4a9a74d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a746 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061474.022061:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596c800/0x427fa11dc4a9a74d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a746 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061474.022071:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596c800/0x427fa11dc4a9a74d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a746 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061474.022078:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c800, rc 0) 00000100:00100000:0.0:1789061474.022144:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779487872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061474.022150:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789061474.022308:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779487872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061474.022322:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061474.022342:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061474.022399:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aeca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779488000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061474.022429:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061474.022460:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789061474.023508:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779488000 00000100:00100000:0.0:1789061474.023518:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779488000 00000100:00100000:0.0:1789061474.023563:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789061474.023573:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779488000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061474.024022:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779488000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 448us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061474.024031:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789061474.024455:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aeca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779488000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061474.024546:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779488128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061474.024755:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061474.024791:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061474.024854:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779488128 00000100:00100000:1.0:1789061474.024859:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779488128 00000100:00100000:1.0:1789061474.024905:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789061474.024915:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779488128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061474.025110:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779488128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061474.025117:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789061474.026432:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779488128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061474.026922:0:8491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8491:1875966779488256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061474.027068:0:8491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061474.027105:0:8491:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061474.028642:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779488256 00000100:00100000:2.0:1789061474.028657:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779488256 00000100:00100000:2.0:1789061474.028714:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789061474.028736:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+15:8491:x1875966779488256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061474.029029:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+15:8491:x1875966779488256:12345-0@lo:502:llog_process_th.0 Request processed in 305us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061474.029039:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789061474.033998:0:8491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8491:1875966779488256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061474.034088:0:8491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8491:1875966779488384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061474.034338:0:8491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061474.034433:0:8491:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061474.034693:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779488384 00000100:00100000:3.0:1789061474.034702:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779488384 00000100:00100000:3.0:1789061474.035002:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789061474.035013:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+15:8491:x1875966779488384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061474.035526:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+15:8491:x1875966779488384:12345-0@lo:502:llog_process_th.0 Request processed in 513us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061474.035535:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789061474.035700:0:8491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8491:1875966779488384:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789061474.035736:0:8491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789061474.036010:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789061474.036031:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789061474.036040:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061474.036051:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061474.036070:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789061474.036072:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789061474.036075:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789061474.036106:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061474.036166:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061474.036256:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061474.036280:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779488512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789061474.036327:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061474.036365:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04180 going to sleep for 11 seconds 00000100:00100000:2.0:1789061474.036559:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779488512 00000100:00100000:2.0:1789061474.036566:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779488512 00000100:00100000:2.0:1789061474.036658:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789061474.036666:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+15:5848:x1875966779488512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061474.036677:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061474.036689:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a75b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a754 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061474.036710:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a754 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061474.036731:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a754 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061474.036739:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fa00, rc 0) 00000100:00100000:2.0:1789061474.036793:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779488512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061474.036800:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789061474.036871:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779488512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061474.036884:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061474.036894:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061474.036940:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779488640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061474.036966:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061474.037423:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04180 going to sleep for 11 seconds 00000100:00100000:1.0:1789061474.037666:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779488640 00000100:00100000:1.0:1789061474.037673:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779488640 00000100:00100000:1.0:1789061474.037704:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789061474.037712:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779488640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061474.038162:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779488640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 449us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061474.038170:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789061474.040060:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779488640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061474.040138:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779488768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061474.040228:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061474.040273:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04180 going to sleep for 11 seconds 00000100:00100000:2.0:1789061474.040426:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779488768 00000100:00100000:2.0:1789061474.040435:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779488768 00000100:00100000:2.0:1789061474.040535:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789061474.040546:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779488768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061474.040721:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779488768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061474.040728:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789061474.041235:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779488768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061474.042426:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8492:1875966779488896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061474.042528:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061474.042566:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04000 going to sleep for 11 seconds 00000100:00100000:2.0:1789061474.043933:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779488896 00000100:00100000:2.0:1789061474.043945:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779488896 00000100:00100000:2.0:1789061474.044009:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789061474.044019:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:8492:x1875966779488896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061474.044433:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:8492:x1875966779488896:12345-0@lo:502:llog_process_th.0 Request processed in 415us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061474.044454:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789061474.045874:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8492:1875966779488896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789061474.045915:0:8492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061474.045925:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061474.045927:0:8492:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789061474.045933:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789061474.045971:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8492:1875966779489024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061474.046051:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061474.046091:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04000 going to sleep for 11 seconds 00000100:00100000:2.0:1789061474.046386:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779489024 00000100:00100000:2.0:1789061474.046393:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779489024 00000100:00100000:2.0:1789061474.046561:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789061474.046572:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:8492:x1875966779489024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061474.046801:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:8492:x1875966779489024:12345-0@lo:502:llog_process_th.0 Request processed in 231us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061474.046860:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8492:1875966779489024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789061474.046882:0:8492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061474.046887:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061474.046889:0:8492:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789061474.046892:0:8492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789061474.048161:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789061474.048248:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789061474.048259:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.048272:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061474.048283:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789061474.048286:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff971a46ca8000 from 39 10000000:01000000:1.0:1789061474.048288:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789061474.048324:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.048333:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.048343:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061474.048365:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779489152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789061474.048419:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061474.048604:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ccce900 going to sleep for 11 seconds 00000100:00100000:1.0:1789061474.048625:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779489152 00000100:00100000:1.0:1789061474.048632:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779489152 00000100:00100000:1.0:1789061474.048665:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789061474.048673:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779489152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061474.048684:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061474.048699:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a769 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a762 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.048723:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a762 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.048733:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a762 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.048741:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4cc84e00, rc 0) 00000100:00100000:1.0:1789061474.048967:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779489152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061474.048973:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789061474.049213:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789061474.053025:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779489152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061474.053060:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061474.053073:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061474.053561:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779489280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061474.053624:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061474.053662:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64ce6540 going to sleep for 11 seconds 00000100:00100000:1.0:1789061474.054216:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779489280 00000100:00100000:1.0:1789061474.054226:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779489280 00000100:00100000:1.0:1789061474.054277:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789061474.054287:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779489280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061474.054611:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779489280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061474.054619:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789061474.054804:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779489280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061474.054847:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779489408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061474.054891:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061474.054914:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64ce6540 going to sleep for 11 seconds 00000100:00100000:1.0:1789061474.055048:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779489408 00000100:00100000:1.0:1789061474.055053:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779489408 00000100:00100000:1.0:1789061474.055089:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789061474.055104:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779489408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061474.055267:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779489408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061474.055274:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789061474.055364:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779489408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061474.056676:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8493:1875966779489536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061474.056748:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061474.056787:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64ce6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789061474.057378:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779489536 00000100:00100000:1.0:1789061474.057386:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779489536 00000100:00100000:1.0:1789061474.057565:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789061474.057575:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+17:8493:x1875966779489536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061474.057832:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+17:8493:x1875966779489536:12345-0@lo:502:llog_process_th.0 Request processed in 258us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061474.057840:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789061474.058248:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8493:1875966779489536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061474.058311:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8493:1875966779489664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061474.058357:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061474.058393:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64ce6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789061474.058603:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779489664 00000100:00100000:1.0:1789061474.058610:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779489664 00000100:00100000:1.0:1789061474.058649:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789061474.058657:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+17:8493:x1875966779489664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061474.058829:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+17:8493:x1875966779489664:12345-0@lo:502:llog_process_th.0 Request processed in 172us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061474.058836:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789061474.059453:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8493:1875966779489664:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789061474.059507:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789061474.059677:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789061474.059696:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789061474.059706:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.059718:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061474.059727:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789061474.059739:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789061474.059742:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789061474.059770:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.059779:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.059788:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061474.059806:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779489792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789061474.059849:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061474.059885:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ccce900 going to sleep for 11 seconds 00000100:00100000:2.0:1789061474.061226:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779489792 00000100:00100000:2.0:1789061474.061239:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779489792 00000100:00100000:2.0:1789061474.061301:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789061474.061323:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779489792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061474.061337:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061474.061354:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a770 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061474.061379:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a770 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061474.061389:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a770 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061474.061397:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e200, rc 0) 00000100:00100000:2.0:1789061474.061470:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779489792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061474.061478:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789061474.062277:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779489792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061474.062301:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061474.062312:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061474.062383:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779489920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061474.062421:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061474.062470:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061474.063413:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779489920 00000100:00100000:2.0:1789061474.063424:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779489920 00000100:00100000:2.0:1789061474.063513:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789061474.063524:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779489920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061474.063801:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779489920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061474.063810:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789061474.064525:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779489920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061474.064577:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779490048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061474.064630:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061474.064660:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061474.064738:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779490048 00000100:00100000:2.0:1789061474.064744:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779490048 00000100:00100000:2.0:1789061474.064788:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789061474.064797:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779490048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061474.064979:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779490048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061474.065448:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789061474.065656:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779490048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061474.066060:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8494:1875966779490176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061474.066108:0:8494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061474.066156:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061474.066351:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779490176 00000100:00100000:1.0:1789061474.066358:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779490176 00000100:00100000:1.0:1789061474.066398:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789061474.066408:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:8494:x1875966779490176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061474.066671:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:8494:x1875966779490176:12345-0@lo:502:llog_process_th.0 Request processed in 264us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061474.066678:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789061474.068252:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8494:1875966779490176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789061474.068303:0:8494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061474.068315:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061474.068318:0:8494:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789061474.068323:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789061474.068362:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8494:1875966779490304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061474.068429:0:8494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061474.068472:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061474.068531:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779490304 00000100:00100000:0.0:1789061474.068538:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779490304 00000100:00100000:0.0:1789061474.068578:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789061474.068586:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+18:8494:x1875966779490304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061474.068849:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+18:8494:x1875966779490304:12345-0@lo:502:llog_process_th.0 Request processed in 263us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061474.068857:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789061474.068898:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8494:1875966779490304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789061474.068917:0:8494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061474.068926:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061474.068928:0:8494:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789061474.068932:0:8494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789061474.070320:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1789061474.070351:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789061474.070361:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.070374:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061474.070384:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789061474.070398:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff971a47d64d40 from 1 10000000:01000000:1.0:1789061474.070401:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789061474.070449:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc85800/0x427fa11dc4a9a77e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.070459:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4cc85800/0x427fa11dc4a9a77e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061474.070470:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4cc85800/0x427fa11dc4a9a77e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061474.070524:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779490432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789061474.070579:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061474.072626:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a575a43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061474.075894:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779490432 00000100:00100000:2.0:1789061474.075913:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779490432 00000100:00100000:2.0:1789061474.076298:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789061474.076312:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779490432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061474.076330:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061474.076349:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63f600/0x427fa11dc4a9a785 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a77e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061474.076379:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63f600/0x427fa11dc4a9a785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a77e expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061474.076390:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63f600/0x427fa11dc4a9a785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a77e expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061474.076399:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f600, rc 0) 00000100:00100000:2.0:1789061474.076527:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779490432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (5947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061474.076534:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789061474.076636:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779490432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061474.076658:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4cc85800/0x427fa11dc4a9a77e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a785 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061474.076667:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4cc85800/0x427fa11dc4a9a77e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a785 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061474.076774:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779490560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061474.076811:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061474.078059:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04180 going to sleep for 11 seconds 00000100:00100000:1.0:1789061474.078631:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779490560 00000100:00100000:1.0:1789061474.078642:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779490560 00000100:00100000:1.0:1789061474.078689:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789061474.078697:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779490560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061474.079204:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779490560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 506us (2391us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789061474.079213:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789061474.079401:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779490560:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789061474.079445:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789061474.079455:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc85800/0x427fa11dc4a9a77e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a785 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061474.079464:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4cc85800/0x427fa11dc4a9a77e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a785 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061474.175955:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061475.069920:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779490816:0@lo:400:kworker.0 00000100:00100000:1.0:1789061475.069997:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061475.070078:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779491328:0@lo:400:kworker.0 00000100:00100000:1.0:1789061475.070119:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061475.070153:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789061475.070160:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779490688:0@lo:400:kworker.0 00000100:00100000:1.0:1789061475.070188:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061475.070229:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779491200:0@lo:400:kworker.0 00000100:00100000:1.0:1789061475.070253:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061475.070281:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779490688 00000100:00100000:1.0:1789061475.070290:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779490688 00000100:00100000:1.0:1789061475.070336:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789061475.070345:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3311:x1875966779490688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061475.070396:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3311:x1875966779490688:12345-0@lo:400:kworker.0 Request processed in 52us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061475.070403:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789061475.070682:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779490688:0@lo:400:kworker.0 00000100:00100000:3.0:1789061475.070789:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779490944:0@lo:400:kworker.0 00000100:00100000:3.0:1789061475.070821:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061475.070851:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061475.070857:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779491072:0@lo:400:kworker.0 00000100:00100000:3.0:1789061475.070880:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061475.072223:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779490816 00000100:00100000:2.0:1789061475.072239:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779490816 00000100:00100000:2.0:1789061475.072293:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779491200 00000100:00100000:2.0:1789061475.072296:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779491200 00000100:00100000:2.0:1789061475.072319:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779490944 00000100:00100000:2.0:1789061475.072322:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779490944 00000100:00100000:2.0:1789061475.072337:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789061475.072345:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779490816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061475.072685:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779491328 00000100:00100000:0.0:1789061475.072690:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779491328 00000100:00100000:0.0:1789061475.072723:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779491072 00000100:00100000:0.0:1789061475.072726:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779491072 00000100:00100000:0.0:1789061475.072749:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789061475.072757:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779491328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061475.072798:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779491328:12345-0@lo:400:kworker.0 Request processed in 42us (2678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061475.072805:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789061475.072820:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789061475.072826:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779491072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061475.072861:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779491072:12345-0@lo:400:kworker.0 Request processed in 35us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061475.072866:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789061475.072885:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789061475.072892:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779491200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061475.072926:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779491200:12345-0@lo:400:kworker.0 Request processed in 35us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061475.072931:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789061475.072946:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789061475.072951:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779490944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061475.072977:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779490944:12345-0@lo:400:kworker.0 Request processed in 26us (2155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061475.072983:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789061475.073052:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c607100 x1875966779491072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061475.073067:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779491072:0@lo:400:kworker.0 00000100:00100000:0.0:1789061475.073081:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779490944:0@lo:400:kworker.0 00000100:00100000:2.0:1789061475.073206:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779490816:12345-0@lo:400:kworker.0 Request processed in 861us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061475.073221:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789061475.073243:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061475.073247:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061475.073250:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061475.073272:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779491200:0@lo:400:kworker.0 00000100:00100000:2.0:1789061475.073283:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779490816:0@lo:400:kworker.0 00010000:00080000:2.0:1789061475.073294:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c605180 x1875966779491328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061475.073304:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779491328:0@lo:400:kworker.0 00010000:00010000:3.0:1789061475.198396:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061475.582077:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779491456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061475.582170:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061475.582945:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779491456 00000100:00100000:0.0:1789061475.582967:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779491456 00000100:00100000:0.0:1789061475.583030:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789061475.583044:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779491456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061475.583085:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061475.583174:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779491456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061475.583181:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789061475.583316:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7cd2ca80 x1875966779491456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061475.583349:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779491456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789061476.223827:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061477.095138:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061477.095185:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061477.095330:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758491136 00000100:00100000:0.0:1789061477.095341:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758491136 00000100:00100000:0.0:1789061477.095423:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1789061477.095434:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758491136:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1789061477.095537:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758491136:12345-192.168.204.54@tcp:400: Request processed in 105us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061477.095545:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1789061477.095614:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758490880 00000100:00100000:2.0:1789061477.095618:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758490880 00000100:00100000:2.0:1789061477.095651:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:2.0:1789061477.095658:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+8:2356:x1875966758490880:12345-192.168.204.54@tcp:400: 00000100:00100000:2.0:1789061477.095692:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+8:2356:x1875966758490880:12345-192.168.204.54@tcp:400: Request processed in 35us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061477.095699:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00080000:3.0:1789061477.095785:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061477.095810:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061477.095853:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061477.095930:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758491008 00000100:00100000:0.0:1789061477.095934:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758491008 00000100:00100000:0.0:1789061477.095980:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:0.0:1789061477.095988:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758491008:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1789061477.096022:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758491008:12345-192.168.204.54@tcp:400: Request processed in 35us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061477.096045:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00080000:3.0:1789061477.096055:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061477.096503:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758491264 00000100:00100000:2.0:1789061477.096510:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758491264 00000100:00100000:2.0:1789061477.096559:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1789061477.096566:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758491264:12345-192.168.204.54@tcp:400: 00000100:00100000:2.0:1789061477.096610:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758491264:12345-192.168.204.54@tcp:400: Request processed in 43us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061477.096617:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00080000:3.0:1789061477.096775:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789061477.245786:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061478.115887:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061478.115996:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758491392 00000100:00100000:2.0:1789061478.116023:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758491392 00000100:00100000:2.0:1789061478.116096:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:2.0:1789061478.116118:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+8:5596:x1875966758491392:12345-192.168.204.54@tcp:101: 00010000:00010000:2.0:1789061478.116135:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061478.116154:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a78c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca89f6d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061478.116184:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a78c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f6d expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061478.116198:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a78c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f6d expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061478.116207:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f000, rc 0) 00000100:00100000:2.0:1789061478.116279:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+9:5596:x1875966758491392:12345-192.168.204.54@tcp:101: Request processed in 173us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061478.116287:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:1.0:1789061478.122626:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061478.126260:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758491520 00000100:00100000:2.0:1789061478.126282:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758491520 00000100:00100000:2.0:1789061478.126592:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:2.0:1789061478.126614:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+9:5596:x1875966758491520:12345-192.168.204.54@tcp:501: 00000100:00100000:2.0:1789061478.126909:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+9:5596:x1875966758491520:12345-192.168.204.54@tcp:501: Request processed in 306us (4305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061478.126917:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:0.0:1789061478.138831:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061478.138926:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758491648 00000100:00100000:1.0:1789061478.138937:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758491648 00000100:00100000:1.0:1789061478.138996:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:1.0:1789061478.139006:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+9:5596:x1875966758491648:12345-192.168.204.54@tcp:503: 00000100:00100000:1.0:1789061478.139447:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+9:5596:x1875966758491648:12345-192.168.204.54@tcp:503: Request processed in 440us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061478.139455:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:3.0:1789061478.141779:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789061478.155395:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061478.157143:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758491776 00000100:00100000:3.0:1789061478.157158:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758491776 00000100:00100000:3.0:1789061478.157232:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:3.0:1789061478.157243:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+9:6087:x1875966758491776:12345-192.168.204.54@tcp:502: 00000100:00100000:3.0:1789061478.157868:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+9:6087:x1875966758491776:12345-192.168.204.54@tcp:502: Request processed in 624us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061478.157878:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:1.0:1789061478.162082:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779491584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061478.162168:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061478.162544:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779491584 00000100:00100000:3.0:1789061478.162553:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779491584 00000100:00080000:2.0:1789061478.162708:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061478.162809:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789061478.162820:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779491584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789061478.162855:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061478.162972:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779491584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061478.162979:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789061478.167077:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971945c92a00 x1875966779491584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061478.167117:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779491584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061478.170391:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061478.170468:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758491904 00000100:00100000:3.0:1789061478.170478:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758491904 00000100:00100000:3.0:1789061478.170554:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:3.0:1789061478.170563:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+9:6087:x1875966758491904:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789061478.170867:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+9:6087:x1875966758491904:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 304us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061478.170874:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:0.0:1789061478.190598:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061478.191304:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758492032 00000100:00100000:3.0:1789061478.191315:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758492032 00000100:00100000:3.0:1789061478.191378:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:3.0:1789061478.191388:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+9:5596:x1875966758492032:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061478.191421:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061478.191441:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a41477400/0x427fa11dc4a9a793 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca89f74 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061478.191472:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41477400/0x427fa11dc4a9a793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f74 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061478.191482:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a41477400/0x427fa11dc4a9a793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f74 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061478.191514:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41477400, rc 0) 00000100:00100000:3.0:1789061478.191583:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5596:x1875966758492032:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 196us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061478.191590:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:0.0:1789061478.200442:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061478.200611:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758492160 00000100:00100000:2.0:1789061478.200621:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758492160 00000100:00100000:2.0:1789061478.200693:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:2.0:1789061478.200704:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5596:x1875966758492160:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061478.201025:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5596:x1875966758492160:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 319us (589us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789061478.201034:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 173 00010000:00010000:3.0:1789061478.269781:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061479.300707:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789061479.557825:0:8533:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2d6f6090 20000000:00000080:3.0:1789061479.557852:0:8533:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff971a7d1a1400 uarg=0000000000000000 20000000:01000000:3.0:1789061479.558463:0:8533:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789061479.558472:0:8533:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789061479.558479:0:8533:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789061479.562938:0:8534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789061479.563259:0:8533:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789061479.573659:0:8533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789061479.573732:0:8533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789061479.573792:0:8533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789061479.573815:0:8533:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789061479.573841:0:8533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061479.573864:0:8533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a40030000/0x427fa11dc4a9a50f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a508 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061479.575138:0:8533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a82042000/0x427fa11dc4a9a571 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a56a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061479.575150:0:8533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a4cc85e00/0x427fa11dc4a9a63c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a635 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061479.575162:0:8533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7596c200/0x427fa11dc4a9a6f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f3c expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061479.575170:0:8533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061479.575235:0:8533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7596c200/0x427fa11dc4a9a6f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f3c expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061479.575256:0:8533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a7596c200/0x427fa11dc4a9a6f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f3c expref: 9 pid: 5845 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061479.575279:0:8533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8533:1875966779491712:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061479.575673:0:8533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a4cc85e00/0x427fa11dc4a9a63c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a635 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061479.575684:0:8533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a4cc85e00/0x427fa11dc4a9a63c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a635 expref: 18 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061479.575695:0:8533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8533:1875966779491840:0@lo:104: 00000100:00100000:3.0:1789061479.575750:0:8533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789061479.575798:0:8533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a82042000/0x427fa11dc4a9a571 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a56a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061479.575824:0:8533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a82042000/0x427fa11dc4a9a571 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a56a expref: 18 pid: 5843 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061479.575833:0:8533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8533:1875966779491968:0@lo:104: 00000100:00100000:3.0:1789061479.575862:0:8533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789061479.576594:0:8533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a40030000/0x427fa11dc4a9a50f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a508 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061479.576608:0:8533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a40030000/0x427fa11dc4a9a50f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a508 expref: 18 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061479.576618:0:8533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aefb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8533:1875966779492096:0@lo:104: 00000100:00100000:3.0:1789061479.576650:0:8533:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04600 going to sleep for 11 seconds 00000100:00100000:0.0:1789061479.579559:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061479.579601:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758492288 00000100:00100000:0.0:1789061479.579613:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758492288 00010000:00010000:0.0:1789061479.579664:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7596c200/0x427fa11dc4a9a6f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f3c expref: 10 pid: 5845 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061479.579706:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789061479.579718:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2356:x1875966758492288:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061479.579737:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061479.579744:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7596c200/0x427fa11dc4a9a6f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f3c expref: 10 pid: 5845 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061479.579760:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7596c200/0x427fa11dc4a9a6f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f3c expref: 10 pid: 5845 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061479.579787:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061479.579851:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2356:x1875966758492288:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 135us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061479.579859:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00010000:00010000:3.0:1789061479.580233:0:8533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7596c200/0x427fa11dc4a9a6f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f3c expref: 9 pid: 5845 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061479.580250:0:8533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8533:1875966779491712:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061479.584460:0:8475:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789061479.584551:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061479.584602:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779491840 00000100:00100000:1.0:1789061479.584615:0:8475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779491840 00000100:00100000:1.0:1789061479.584675:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779491968 00000100:00100000:1.0:1789061479.584678:0:8475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779491968 00000100:00100000:1.0:1789061479.584690:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779492096 00000100:00100000:1.0:1789061479.584692:0:8475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779492096 00000100:00100000:1.0:1789061479.584705:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789061479.584716:0:8475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:24dfd7ac-7455-4043-9449-a564380782df+5:8533:x1875966779491840:12345-0@lo:104: 00010000:00010000:1.0:1789061479.584738:0:8475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a63c expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.584827:0:8475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789061479.584834:0:8475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:24dfd7ac-7455-4043-9449-a564380782df+5:8533:x1875966779491840:12345-0@lo:104: Request processed in 121us (9085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061479.584843:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789061479.584865:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789061479.584872:0:8475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971944c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:24dfd7ac-7455-4043-9449-a564380782df+4:8533:x1875966779491968:12345-0@lo:104: 00010000:00010000:1.0:1789061479.584900:0:8475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a571 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.584937:0:8475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789061479.584943:0:8475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971944c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:24dfd7ac-7455-4043-9449-a564380782df+4:8533:x1875966779491968:12345-0@lo:104: Request processed in 72us (9080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061479.584971:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789061479.585031:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789061479.585039:0:8475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:24dfd7ac-7455-4043-9449-a564380782df+3:8533:x1875966779492096:12345-0@lo:104: 00010000:00010000:1.0:1789061479.585047:0:8475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a50f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585086:0:8475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789061479.585091:0:8475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:24dfd7ac-7455-4043-9449-a564380782df+3:8533:x1875966779492096:12345-0@lo:104: Request processed in 55us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061479.585097:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789061479.585131:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789061479.585138:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a63c expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585145:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc85c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061479.585151:0:8476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a63c expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585160:0:8476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a63c expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061479.585168:0:8476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a63c expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061479.585174:0:8476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789061479.585219:0:8476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a63c expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585226:0:8476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061479.585258:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a63c expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585266:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4cc85c00/0x427fa11dc4a9a635 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a63c expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585284:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789061479.585288:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a571 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585294:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc84a00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061479.585296:0:8476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a571 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585303:0:8476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a571 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061479.585309:0:8476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a571 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061479.585313:0:8476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789061479.585328:0:8476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a571 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585333:0:8476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061479.585339:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a571 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585345:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4cc84a00/0x427fa11dc4a9a56a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a571 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585354:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061479.585363:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a50f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585369:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061479.585371:0:8476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a50f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585377:0:8476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a50f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061479.585383:0:8476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a50f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061479.585388:0:8476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789061479.585404:0:8476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a508 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a50f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585409:0:8476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061479.585426:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a508 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a50f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585432:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a508 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a50f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585449:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061479.585451:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061479.585452:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061479.585460:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061479.585470:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061479.585511:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779492480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061479.585555:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061479.585614:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779492480 00000100:00100000:1.0:1789061479.585620:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779492480 00010000:00010000:1.0:1789061479.585644:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a40030000/0x427fa11dc4a9a50f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a508 expref: 19 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061479.585672:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789061479.585679:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779492480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061479.585691:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061479.585697:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a40030000/0x427fa11dc4a9a50f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a508 expref: 19 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585708:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a40030000/0x427fa11dc4a9a50f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a508 expref: 19 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.585729:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061479.585759:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779492480:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061479.585766:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789061479.585809:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779492480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061479.586895:0:8533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8533:1875966779491840:0@lo:104: 00000100:00100000:3.0:1789061479.586914:0:8533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8533:1875966779491968:0@lo:104: 00010000:00010000:3.0:1789061479.586927:0:8533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a40030000/0x427fa11dc4a9a50f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a508 expref: 18 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061479.586941:0:8533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aefb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8533:1875966779492096:0@lo:104: 00010000:00010000:3.0:1789061479.586983:0:8533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061479.592662:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779492352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789061479.592780:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061479.592851:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061479.592859:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779492224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789061479.592884:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061479.593035:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061479.595760:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779492352 00000100:00100000:3.0:1789061479.595803:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779492352 00000100:00100000:2.0:1789061479.595804:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779492224 00000100:00100000:2.0:1789061479.595809:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779492224 00010000:00010000:2.0:1789061479.595934:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a4cc85e00/0x427fa11dc4a9a63c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a635 expref: 19 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061479.595983:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789061479.595994:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+19:3311:x1875966779492224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789061479.596015:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061479.596033:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a4cc85e00/0x427fa11dc4a9a63c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a635 expref: 19 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061479.596049:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a4cc85e00/0x427fa11dc4a9a63c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a635 expref: 19 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061479.596080:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4cc85e00/0x427fa11dc4a9a63c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a635 expref: 19 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061479.596101:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061479.596225:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+18:3311:x1875966779492224:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (3339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061479.596233:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789061479.596329:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779492224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789061479.602864:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a82042000/0x427fa11dc4a9a571 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a56a expref: 18 pid: 5843 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061479.602966:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789061479.602996:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24dfd7ac-7455-4043-9449-a564380782df+18:3311:x1875966779492352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061479.603031:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061479.603039:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a82042000/0x427fa11dc4a9a571 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a56a expref: 18 pid: 5843 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.603056:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a82042000/0x427fa11dc4a9a571 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a56a expref: 18 pid: 5843 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.603089:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a82042000/0x427fa11dc4a9a571 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a56a expref: 18 pid: 5843 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.603144:0:7648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.603155:0:7648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.603192:0:7648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.603201:0:7648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.603210:0:7648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.603218:0:7648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.603225:0:7648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061479.603231:0:7648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.603242:0:7648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.603278:0:7648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061479.603294:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061479.603414:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24dfd7ac-7455-4043-9449-a564380782df+17:3311:x1875966779492352:12345-0@lo:103:ldlm_bl.0 Request processed in 436us (10633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061479.603435:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789061479.604123:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779492352:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789061479.609374:0:8533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061479.609401:0:8533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061479.609409:0:8533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a79a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061480.004535:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061480.004647:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758492416 00000100:00100000:3.0:1789061480.004658:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758492416 00000100:00100000:3.0:1789061480.004717:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:3.0:1789061480.004728:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+9:5596:x1875966758492416:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061480.004746:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061480.004767:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a7a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca89f7b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061480.004807:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a7a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f7b expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061480.004821:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a7a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f7b expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061480.004830:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476600, rc 0) 00000100:00100000:3.0:1789061480.004891:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5596:x1875966758492416:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 164us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061480.004915:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:0.0:1789061480.035541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061480.035728:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758492544 00000100:00100000:2.0:1789061480.035739:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758492544 00000100:00100000:2.0:1789061480.035818:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:2.0:1789061480.035829:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5596:x1875966758492544:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061480.036160:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5596:x1875966758492544:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 332us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061480.036169:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:0.0:1789061480.043747:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061480.044869:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758492672 00000100:00100000:2.0:1789061480.044887:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758492672 00000100:00100000:2.0:1789061480.044979:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:2.0:1789061480.044994:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5596:x1875966758492672:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061480.045694:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:5596:x1875966758492672:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 700us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061480.045704:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:1.0:1789061480.056622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061480.059264:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758492800 00000100:00100000:3.0:1789061480.059285:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758492800 00000100:00100000:3.0:1789061480.060293:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:3.0:1789061480.060312:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:6144:x1875966758492800:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789061480.070820:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:6144:x1875966758492800:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 10496us (14200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061480.070839:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:3.0:1789061480.077847:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061480.078166:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758492928 00000100:00100000:2.0:1789061480.078181:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758492928 00000100:00100000:2.0:1789061480.078254:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:2.0:1789061480.078266:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:6144:x1875966758492928:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789061480.082182:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:6144:x1875966758492928:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 513us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061480.082203:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:2.0:1789061480.204581:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779492992:0@lo:400:kworker.0 00000100:00100000:2.0:1789061480.204690:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061480.204783:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789061480.204791:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779492608:0@lo:400:kworker.0 00000100:00100000:2.0:1789061480.204824:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061480.204848:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779493120:0@lo:400:kworker.0 00000100:00100000:2.0:1789061480.204876:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061480.204904:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779492736:0@lo:400:kworker.0 00000100:00100000:2.0:1789061480.204926:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061480.204943:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779493248:0@lo:400:kworker.0 00000100:00100000:3.0:1789061480.205284:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779492608 00000100:00100000:3.0:1789061480.205295:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779492608 00000100:00100000:3.0:1789061480.205363:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789061480.205376:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:3312:x1875966779492608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061480.205444:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+16:3312:x1875966779492608:12345-0@lo:400:kworker.0 Request processed in 70us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061480.205451:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789061480.205514:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779492992 00000100:00100000:3.0:1789061480.205519:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779492992 00000100:00100000:3.0:1789061480.205563:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789061480.205571:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779492992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061480.205607:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779492992:12345-0@lo:400:kworker.0 Request processed in 37us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061480.205613:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789061480.205637:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779492864:0@lo:400:kworker.0 00000100:00100000:3.0:1789061480.205666:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061480.205728:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779492608:0@lo:400:kworker.0 00010000:00080000:3.0:1789061480.205759:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c606680 x1875966779492992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061480.205790:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779492992:0@lo:400:kworker.0 00000100:00080000:3.0:1789061480.205825:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061480.205842:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779493120 00000100:00100000:3.0:1789061480.205845:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779493120 00000100:00100000:3.0:1789061480.205876:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779492736 00000100:00100000:3.0:1789061480.205879:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779492736 00000100:00100000:3.0:1789061480.205890:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779492864 00000100:00100000:3.0:1789061480.205893:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779492864 00000100:00100000:3.0:1789061480.205908:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789061480.205914:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779493120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061480.205963:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779493120:12345-0@lo:400:kworker.0 Request processed in 49us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061480.205970:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789061480.205985:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789061480.205990:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779492736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061480.206028:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779492736:12345-0@lo:400:kworker.0 Request processed in 37us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061480.206034:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789061480.206047:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789061480.206052:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779492864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061480.206093:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779492864:12345-0@lo:400:kworker.0 Request processed in 41us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061480.206099:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789061480.206119:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061480.206138:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779492864:0@lo:400:kworker.0 00000100:00100000:3.0:1789061480.206179:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779493120:0@lo:400:kworker.0 00000100:00100000:2.0:1789061480.206708:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061480.206747:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779492736:0@lo:400:kworker.0 00000100:00100000:3.0:1789061480.206854:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779493248 00000100:00100000:3.0:1789061480.206861:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779493248 00000100:00100000:3.0:1789061480.207042:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789061480.207051:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779493248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061480.207112:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779493248:12345-0@lo:400:kworker.0 Request processed in 62us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061480.207119:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789061480.207150:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c605500 x1875966779493248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061480.207162:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779493248:0@lo:400:kworker.0 00000100:00080000:2.0:1789061480.208657:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789061480.317853:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061480.702600:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061480.702634:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779493376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061480.702723:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061480.702835:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779493376 00000100:00100000:0.0:1789061480.702845:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779493376 00000100:00100000:0.0:1789061480.702908:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789061480.702918:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779493376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061480.702962:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061480.703028:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779493376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061480.703036:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789061480.703119:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7cd2f100 x1875966779493376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061480.703141:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779493376:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1789061481.221889:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789061481.221900:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a75aff800 from 4 10000000:01000000:3.0:1789061481.221908:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789061481.221976:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061481.222002:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061481.222018:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061481.222056:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779493504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789061481.222146:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061481.222206:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04180 going to sleep for 11 seconds 00000100:00100000:3.0:1789061481.222236:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779493504 00000100:00100000:3.0:1789061481.222261:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779493504 00000100:00100000:3.0:1789061481.222323:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789061481.222332:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779493504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061481.222349:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061481.222366:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a7af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a7a8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061481.222395:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a7af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a7a8 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061481.222409:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a7af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a7a8 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061481.222420:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41477800, rc 0) 00000100:00100000:3.0:1789061481.222467:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779493504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061481.222474:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789061481.222562:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779493504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061481.222579:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a7af expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061481.222590:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a7af expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061481.222654:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779493632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061481.222682:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061481.222696:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04180 going to sleep for 11 seconds 00000100:00100000:3.0:1789061481.222710:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779493632 00000100:00100000:3.0:1789061481.222721:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779493632 00000100:00100000:3.0:1789061481.222745:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789061481.222752:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779493632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061481.223043:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779493632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061481.223051:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789061481.223138:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779493632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061481.223170:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779493760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061481.223213:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061481.223226:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04180 going to sleep for 11 seconds 00000100:00100000:3.0:1789061481.223239:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779493760 00000100:00100000:3.0:1789061481.223243:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779493760 00000100:00100000:3.0:1789061481.223263:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789061481.223269:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779493760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061481.223433:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779493760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061481.223440:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789061481.223477:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779493760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061481.246411:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8589:1875966779493888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061481.246544:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061481.246598:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a75b3f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789061481.247560:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779493888 00000100:00100000:0.0:1789061481.247574:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779493888 00000100:00100000:0.0:1789061481.247650:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789061481.247661:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+17:8589:x1875966779493888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061481.249125:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+17:8589:x1875966779493888:12345-0@lo:502:llog_process_th.0 Request processed in 1457us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061481.249138:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789061481.249245:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8589:1875966779493888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789061481.249310:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061481.249323:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061481.249326:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789061481.249335:0:8589:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff971a75aff800 00000020:00000080:0.0:1789061481.249337:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789061481.250604:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8589:1875966779494016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061481.250702:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061481.250879:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a75b3f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789061481.250966:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779494016 00000100:00100000:3.0:1789061481.250977:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779494016 00000100:00100000:3.0:1789061481.251052:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789061481.251063:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:8589:x1875966779494016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061481.251316:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:8589:x1875966779494016:12345-0@lo:502:llog_process_th.0 Request processed in 254us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061481.251325:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789061481.254891:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8589:1875966779494016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789061481.254964:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061481.254978:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061481.254981:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789061481.254998:0:8589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789061481.259803:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789061481.259857:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789061481.259876:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a7af expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.259893:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a7af expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061481.259908:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789061481.259911:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a7618e800 from 4 10000000:01000000:1.0:1789061481.259915:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789061481.259999:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.260008:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.260021:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061481.260054:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779494144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789061481.260140:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061481.260203:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a75b3fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789061481.263370:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779494144 00000100:00100000:1.0:1789061481.263395:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779494144 00000100:00100000:1.0:1789061481.263502:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789061481.263515:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779494144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061481.263538:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061481.263564:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9a7bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a7b6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.263602:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9a7bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a7b6 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.263629:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9a7bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a7b6 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.263641:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524000, rc 0) 00000100:00100000:1.0:1789061481.263740:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779494144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (3600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061481.263876:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789061481.263968:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779494144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061481.264003:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a7bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.264017:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a7bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061481.264115:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779494272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061481.264152:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061481.264175:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a75b3fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789061481.264196:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779494272 00000100:00100000:1.0:1789061481.264201:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779494272 00000100:00100000:1.0:1789061481.264222:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789061481.264229:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779494272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061481.264557:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779494272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061481.264566:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789061481.264600:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779494272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061481.268570:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779494400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061481.268679:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061481.268721:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a75b3fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789061481.268762:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779494400 00000100:00100000:1.0:1789061481.268770:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779494400 00000100:00100000:1.0:1789061481.268842:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789061481.268852:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779494400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061481.269108:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779494400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 257us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061481.269125:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789061481.269298:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779494400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061481.277368:0:8592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8592:1875966779494528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061481.277519:0:8592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061481.277578:0:8592:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2540 going to sleep for 11 seconds 00000100:00100000:1.0:1789061481.277732:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779494528 00000100:00100000:1.0:1789061481.277742:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779494528 00000100:00100000:1.0:1789061481.277798:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789061481.277809:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+18:8592:x1875966779494528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061481.278103:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+18:8592:x1875966779494528:12345-0@lo:502:llog_process_th.0 Request processed in 295us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061481.278112:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789061481.278181:0:8592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8592:1875966779494528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789061481.278217:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061481.278231:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061481.278233:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789061481.278246:0:8592:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff971a7618e800 00000020:00000080:1.0:1789061481.278249:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789061481.278342:0:8592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8592:1875966779494656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061481.278381:0:8592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061481.278405:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779494656 00000100:00100000:1.0:1789061481.278409:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779494656 00000100:00100000:1.0:1789061481.278431:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789061481.278438:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:8592:x1875966779494656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061481.278572:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:8592:x1875966779494656:12345-0@lo:502:llog_process_th.0 Request processed in 134us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061481.278580:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789061481.278610:0:8592:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a75b3f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789061481.278629:0:8592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8592:1875966779494656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789061481.278654:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061481.278658:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061481.278660:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789061481.278665:0:8592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789061481.278738:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789061481.278765:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789061481.278777:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a7bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.278790:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a7bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061481.278804:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789061481.278807:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a46ca8000 from 4 10000000:01000000:1.0:1789061481.278810:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789061481.278839:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.278848:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.278858:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061481.278873:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779494784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789061481.278902:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061481.278915:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a75b3f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789061481.278933:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779494784 00000100:00100000:1.0:1789061481.278936:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779494784 00000100:00100000:1.0:1789061481.278964:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789061481.278970:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779494784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061481.278979:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061481.279007:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9a7cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a7c4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.279032:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9a7cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a7c4 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.279044:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9a7cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a7c4 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.279052:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524600, rc 0) 00000100:00100000:1.0:1789061481.279080:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779494784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061481.279086:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789061481.279116:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779494784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061481.279130:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a7cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061481.279140:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a7cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061481.279185:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779494912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061481.279209:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061481.279221:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a75b3f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789061481.279232:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779494912 00000100:00100000:1.0:1789061481.279235:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779494912 00000100:00100000:1.0:1789061481.279261:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789061481.279266:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779494912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061481.279545:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779494912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061481.279552:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789061481.279584:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779494912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061481.279616:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779495040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061481.279657:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061481.279671:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a448eb240 going to sleep for 11 seconds 00000100:00100000:1.0:1789061481.279685:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779495040 00000100:00100000:1.0:1789061481.279688:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779495040 00000100:00100000:1.0:1789061481.279710:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789061481.279716:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779495040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061481.279848:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779495040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061481.279856:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789061481.279895:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779495040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061481.296821:0:8594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8594:1875966779495168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061481.301028:0:8594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061481.301199:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779495168 00000100:00100000:0.0:1789061481.301212:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779495168 00000100:00100000:0.0:1789061481.301279:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789061481.301291:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:8594:x1875966779495168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061481.304957:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:8594:x1875966779495168:12345-0@lo:502:llog_process_th.0 Request processed in 3658us (3930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061481.304977:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789061481.316332:0:8594:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a460f0480 going to sleep for 11 seconds 00000100:00100000:0.0:1789061481.316386:0:8594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8594:1875966779495168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789061481.316439:0:8594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061481.316452:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061481.316455:0:8594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789061481.316465:0:8594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff971a46ca8000 00000020:00000080:0.0:1789061481.316468:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789061481.317031:0:8594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8594:1875966779495296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061481.317125:0:8594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061481.317180:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779495296 00000100:00100000:0.0:1789061481.317189:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779495296 00000100:00100000:0.0:1789061481.317241:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789061481.317254:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:8594:x1875966779495296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061481.317577:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:8594:x1875966779495296:12345-0@lo:502:llog_process_th.0 Request processed in 325us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061481.317587:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789061481.317639:0:8594:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a75b3ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789061481.317659:0:8594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:8594:1875966779495296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789061481.317684:0:8594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061481.317691:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061481.317693:0:8594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789061481.317698:0:8594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789061481.317795:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789061481.317823:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789061481.317836:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a7cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061481.317850:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a7cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061481.351829:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061482.211624:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061482.211668:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061482.211696:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061482.211725:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061482.211760:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758493184 00000100:00100000:3.0:1789061482.211774:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758493184 00000100:00100000:3.0:1789061482.211860:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:3.0:1789061482.211872:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758493184:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061482.211986:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758493184:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 116us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061482.211994:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:3.0:1789061482.212020:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758493312 00000100:00100000:3.0:1789061482.212024:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758493312 00000100:00100000:3.0:1789061482.212054:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758493440 00000100:00100000:3.0:1789061482.212057:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758493440 00000100:00100000:3.0:1789061482.212079:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:3.0:1789061482.212085:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758493312:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061482.212112:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758493312:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061482.212119:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:3.0:1789061482.212131:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1789061482.212137:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758493440:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061482.212200:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758493440:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 62us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061482.212207:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00080000:3.0:1789061482.212225:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061482.212230:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789061482.212233:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061482.212830:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758493056 00000100:00100000:0.0:1789061482.212837:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758493056 00000100:00100000:0.0:1789061482.212883:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:0.0:1789061482.212892:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2355:x1875966758493056:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061482.212940:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2355:x1875966758493056:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 50us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061482.212947:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 195 00010000:00010000:1.0:1789061482.365653:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061483.262205:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061483.272170:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779495424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061483.272280:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061483.272574:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779495424 00000100:00100000:1.0:1789061483.272586:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779495424 00000100:00100000:1.0:1789061483.272687:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789061483.272700:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779495424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061483.272755:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789061483.272936:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061483.273003:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779495424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 305us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061483.273026:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789061483.273726:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7613ca80 x1875966779495424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061483.273755:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779495424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789061483.389864:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061484.415710:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061485.310380:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779495552:0@lo:400:kworker.0 00000100:00100000:0.0:1789061485.310454:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061485.311349:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779495552 00000100:00100000:1.0:1789061485.311360:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779495552 00000100:00100000:1.0:1789061485.311415:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789061485.311425:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779495552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061485.312215:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779495936:0@lo:400:kworker.0 00000100:00100000:3.0:1789061485.312269:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061485.312305:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061485.312311:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779496064:0@lo:400:kworker.0 00000100:00100000:3.0:1789061485.312334:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061485.312362:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779495680:0@lo:400:kworker.0 00000100:00100000:3.0:1789061485.312383:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061485.312400:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779496192:0@lo:400:kworker.0 00000100:00100000:3.0:1789061485.312419:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061485.312435:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061485.312440:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779495808:0@lo:400:kworker.0 00000100:00100000:3.0:1789061485.312458:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061485.312507:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779496064 00000100:00100000:3.0:1789061485.312512:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779496064 00000100:00100000:3.0:1789061485.312549:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779495680 00000100:00100000:3.0:1789061485.312552:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779495680 00000100:00100000:3.0:1789061485.312563:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779495808 00000100:00100000:3.0:1789061485.312566:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779495808 00000100:00100000:3.0:1789061485.312580:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789061485.312587:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779496064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061485.312636:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779496064:12345-0@lo:400:kworker.0 Request processed in 49us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061485.312643:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789061485.312659:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789061485.312665:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779495680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061485.312695:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779495680:12345-0@lo:400:kworker.0 Request processed in 30us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061485.312700:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789061485.312712:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789061485.312718:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779495808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061485.312743:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779495808:12345-0@lo:400:kworker.0 Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061485.312750:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789061485.312773:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779495936 00000100:00100000:3.0:1789061485.312776:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779495936 00000100:00100000:3.0:1789061485.312802:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779496192 00000100:00100000:3.0:1789061485.312805:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779496192 00000100:00100000:3.0:1789061485.312827:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789061485.312833:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779495936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061485.312862:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779495936:12345-0@lo:400:kworker.0 Request processed in 30us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061485.312868:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789061485.312879:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789061485.312884:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779496192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061485.312921:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779496192:12345-0@lo:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061485.312937:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789061485.312957:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061485.312961:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789061485.312963:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061485.313001:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779495808:0@lo:400:kworker.0 00000100:00100000:3.0:1789061485.313011:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779495680:0@lo:400:kworker.0 00010000:00080000:3.0:1789061485.313020:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75aece00 x1875966779496192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061485.313029:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779496192:0@lo:400:kworker.0 00000100:00100000:3.0:1789061485.313063:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779496064:0@lo:400:kworker.0 00010000:00080000:3.0:1789061485.313071:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75aedf80 x1875966779495936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061485.313079:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779495936:0@lo:400:kworker.0 00000100:00100000:1.0:1789061485.313935:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779495552:12345-0@lo:400:kworker.0 Request processed in 2508us (3477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061485.313946:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789061485.314115:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779495552:0@lo:400:kworker.0 00010000:00010000:2.0:1789061485.444331:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061485.821649:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779496320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061485.821735:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061485.821820:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779496320 00000100:00100000:1.0:1789061485.821827:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779496320 00000100:00100000:1.0:1789061485.821889:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789061485.821907:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779496320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061485.821945:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061485.821991:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779496320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061485.821999:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789061485.822043:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7613ed80 x1875966779496320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061485.822061:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779496320:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789061486.461685:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789061487.063220:0:8831:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1789061487.342099:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061487.342389:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061487.342425:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061487.342461:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061487.342515:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758493824 00000100:00100000:3.0:1789061487.342524:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758493824 00000100:00100000:3.0:1789061487.342577:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758493952 00000100:00100000:3.0:1789061487.342581:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758493952 00000100:00100000:3.0:1789061487.342605:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1789061487.342614:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2352:x1875966758493824:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:3.0:1789061487.342667:0:6701:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a707 00000100:00080000:3.0:1789061487.342677:0:6701:0:(import.c:65:import_set_state_nolock()) ffff971a7611b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789061487.342713:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789061487.343441:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758493696 00000100:00100000:2.0:1789061487.343449:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758493696 00000100:00100000:2.0:1789061487.343516:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:2.0:1789061487.343526:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758493696:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061487.343595:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758493696:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 71us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061487.343602:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:0.0:1789061487.344001:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1789061487.344014:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2352:x1875966758493952:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:0.0:1789061487.344039:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a70e 00000100:00080000:0.0:1789061487.344048:0:6702:0:(import.c:65:import_set_state_nolock()) ffff971a7611a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789061487.344078:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789061487.344121:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758493568 00000100:00100000:1.0:1789061487.344127:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758493568 00000100:00100000:1.0:1789061487.344166:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 197 00000100:00100000:1.0:1789061487.344173:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2355:x1875966758493568:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061487.344221:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2355:x1875966758493568:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 47us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061487.344228:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 197 00000100:00100000:0.0:1789061487.344342:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+2:2352:x1875966758493952:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 331us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061487.344349:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00010000:00010000:2.0:1789061487.344737:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061487.345104:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+2:2352:x1875966758493824:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 2488us (2674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061487.345112:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00080000:3.0:1789061487.345151:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061487.345165:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061487.345167:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789061487.345214:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061487.488788:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061488.388949:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779496448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061488.389025:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061488.389147:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779496448 00000100:00100000:1.0:1789061488.389156:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779496448 00000100:00100000:1.0:1789061488.389232:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789061488.389243:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779496448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061488.389280:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061488.389328:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779496448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061488.389335:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789061488.389451:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789061488.389513:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7613ed80 x1875966779496448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061488.389532:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779496448:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789061488.509784:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061489.535872:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061490.429844:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779496576:0@lo:400:kworker.0 00000100:00100000:1.0:1789061490.429874:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779496704:0@lo:400:kworker.0 00000100:00100000:2.0:1789061490.429986:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779496960:0@lo:400:kworker.0 00000100:00100000:2.0:1789061490.437382:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061490.437474:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779496960 00000100:00100000:2.0:1789061490.437483:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779496960 00000100:00100000:2.0:1789061490.437553:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789061490.437563:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779496960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061490.437620:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779496960:12345-0@lo:400:kworker.0 Request processed in 59us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061490.437627:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789061490.437650:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061490.437699:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75aec380 x1875966779496960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061490.437715:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779496960:0@lo:400:kworker.0 00000100:00100000:1.0:1789061490.441882:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061490.441957:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779497216:0@lo:400:kworker.0 00000100:00100000:1.0:1789061490.442022:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061490.442067:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061490.442074:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779496832:0@lo:400:kworker.0 00000100:00100000:1.0:1789061490.442094:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061490.442131:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779496704 00000100:00100000:1.0:1789061490.442139:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779496704 00000100:00100000:1.0:1789061490.442179:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779496832 00000100:00100000:1.0:1789061490.442181:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779496832 00000100:00100000:1.0:1789061490.442208:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789061490.442215:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779496704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061490.442263:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779496704:12345-0@lo:400:kworker.0 Request processed in 48us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061490.442282:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789061490.442298:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789061490.442303:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779496832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061490.442326:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779496832:12345-0@lo:400:kworker.0 Request processed in 24us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061490.442331:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789061490.442351:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061490.442376:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779496832:0@lo:400:kworker.0 00000100:00100000:1.0:1789061490.442386:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779496704:0@lo:400:kworker.0 00000100:00100000:2.0:1789061490.443298:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779497216 00000100:00100000:2.0:1789061490.443307:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779497216 00000100:00100000:2.0:1789061490.443352:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789061490.443360:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779497216:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789061490.443390:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061490.443418:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779497216:12345-0@lo:400:kworker.0 Request processed in 60us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061490.443424:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789061490.443429:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a47c2b480 x1875966779497216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061490.443441:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779497216:0@lo:400:kworker.0 00000100:00100000:3.0:1789061490.449846:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061490.449915:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779497088:0@lo:400:kworker.0 00000100:00100000:3.0:1789061490.449979:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061490.450016:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779497088 00000100:00100000:3.0:1789061490.450024:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779497088 00000100:00100000:3.0:1789061490.450082:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789061490.450090:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779497088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061490.450155:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779497088:12345-0@lo:400:kworker.0 Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061490.450162:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1789061490.450187:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061490.450227:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779497088:0@lo:400:kworker.0 00000100:00100000:1.0:1789061490.450612:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779496576 00000100:00100000:1.0:1789061490.450617:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779496576 00000100:00100000:1.0:1789061490.450652:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789061490.450659:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779496576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061490.450722:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779496576:12345-0@lo:400:kworker.0 Request processed in 64us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061490.450729:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789061490.454892:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779496576:0@lo:400:kworker.0 00010000:00010000:3.0:1789061490.557738:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061490.947462:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779497344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061490.947563:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061490.947654:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779497344 00000100:00100000:3.0:1789061490.947663:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779497344 00000100:00100000:3.0:1789061490.947714:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789061490.947724:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779497344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061490.948871:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061490.948956:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779497344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1233us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061490.948966:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789061490.949732:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a47c2a300 x1875966779497344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061490.949759:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779497344:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789061490.994172:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 778edf7b-5a2f-4729-afd3-c88291fdad66 00000020:00000080:2.0:1789061490.994185:0:6725:0:(genops.c:885:class_export_put()) final put ffff971a76119000/778edf7b-5a2f-4729-afd3-c88291fdad66 00000020:00000080:1.0:1789061491.000334:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a76119000/778edf7b-5a2f-4729-afd3-c88291fdad66 for lustre-OST0000 00000020:00000080:1.0:1789061491.000413:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a7611b800 for lustre-OST0000 00010000:00010000:2.0:1789061491.584725:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789061492.039844:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 778edf7b-5a2f-4729-afd3-c88291fdad66 00000020:00000080:0.0:1789061492.039854:0:7660:0:(genops.c:885:class_export_put()) final put ffff971a7611f800/778edf7b-5a2f-4729-afd3-c88291fdad66 00000020:00000080:0.0:1789061492.039886:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff971a7611f800/778edf7b-5a2f-4729-afd3-c88291fdad66 for lustre-OST0001 00000020:00000080:0.0:1789061492.039931:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a7611a800 for lustre-OST0001 00000100:00100000:3.0:1789061492.460571:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061492.460622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061492.460657:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758494208 00000100:00100000:0.0:1789061492.460657:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758494080 00000100:00100000:3.0:1789061492.460666:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758494208 00000100:00100000:0.0:1789061492.460666:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758494080 00000100:00100000:3.0:1789061492.460713:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:0.0:1789061492.460713:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 199 00000100:00100000:3.0:1789061492.460722:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2354:x1875966758494208:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061492.460722:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2354:x1875966758494080:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061492.460800:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2354:x1875966758494208:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 79us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061492.460807:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00080000:3.0:1789061492.460828:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061492.462923:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2354:x1875966758494080:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 2192us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061492.462938:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 199 00010000:00010000:3.0:1789061492.606882:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789061493.367455:0:9076:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing yml_node 00000100:00100000:1.0:1789061493.502845:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779497472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061493.502916:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061493.502999:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779497472 00000100:00100000:1.0:1789061493.503008:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779497472 00000100:00100000:1.0:1789061493.503061:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789061493.503071:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779497472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061493.503108:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061493.503150:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779497472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061493.503156:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789061493.503177:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061493.503219:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7613c000 x1875966779497472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061493.503238:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779497472:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789061493.638254:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061494.657395:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061495.550211:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779497856:0@lo:400:kworker.0 00000100:00100000:2.0:1789061495.550311:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061495.550397:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789061495.550404:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779497728:0@lo:400:kworker.0 00000100:00100000:2.0:1789061495.550430:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061495.550448:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779498240:0@lo:400:kworker.0 00000100:00100000:2.0:1789061495.550474:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061495.550548:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779498240 00000100:00100000:2.0:1789061495.550557:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779498240 00000100:00100000:2.0:1789061495.550628:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789061495.550639:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779498240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061495.550701:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779498240:12345-0@lo:400:kworker.0 Request processed in 64us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061495.550708:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1789061495.550775:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c605180 x1875966779498240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061495.551100:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779497984:0@lo:400:kworker.0 00000100:00100000:3.0:1789061495.551148:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061495.551182:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789061495.551190:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779497600:0@lo:400:kworker.0 00000100:00100000:3.0:1789061495.551222:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061495.551251:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779498112:0@lo:400:kworker.0 00000100:00100000:3.0:1789061495.551298:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061495.551329:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779497856 00000100:00100000:3.0:1789061495.551334:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779497856 00000100:00100000:3.0:1789061495.551369:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779497728 00000100:00100000:3.0:1789061495.551373:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779497728 00000100:00100000:3.0:1789061495.551386:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779498112 00000100:00100000:3.0:1789061495.551388:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779498112 00000100:00100000:3.0:1789061495.551403:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789061495.551411:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779497856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061495.551450:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779497856:12345-0@lo:400:kworker.0 Request processed in 40us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061495.551457:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789061495.551471:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789061495.551476:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779497728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061495.551529:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779497728:12345-0@lo:400:kworker.0 Request processed in 52us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061495.551534:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789061495.551547:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789061495.551553:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779498112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061495.551584:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779498112:12345-0@lo:400:kworker.0 Request processed in 31us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061495.551590:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789061495.551633:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779497600 00000100:00100000:3.0:1789061495.551638:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779497600 00000100:00100000:3.0:1789061495.551664:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789061495.551671:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779497600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061495.551739:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779497600:12345-0@lo:400:kworker.0 Request processed in 67us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061495.551753:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789061495.551938:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779497984 00000100:00100000:0.0:1789061495.551945:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779497984 00000100:00100000:0.0:1789061495.551988:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789061495.551995:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779497984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061495.552035:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779497984:12345-0@lo:400:kworker.0 Request processed in 41us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061495.552041:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789061495.552306:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061495.552313:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061495.552316:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061495.552707:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779498240:0@lo:400:kworker.0 00000100:00100000:2.0:1789061495.552754:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779497856:0@lo:400:kworker.0 00000100:00100000:2.0:1789061495.552924:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779497728:0@lo:400:kworker.0 00000100:00100000:3.0:1789061495.553003:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779497600:0@lo:400:kworker.0 00000100:00100000:3.0:1789061495.553024:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779498112:0@lo:400:kworker.0 00010000:00080000:3.0:1789061495.553041:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c607800 x1875966779497984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061495.553052:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779497984:0@lo:400:kworker.0 00010000:00010000:2.0:1789061495.681448:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061496.064160:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779498368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061496.064249:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061496.064453:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779498368 00000100:00100000:3.0:1789061496.064463:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779498368 00000100:00100000:3.0:1789061496.064548:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789061496.064557:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779498368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061496.064597:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061496.064650:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779498368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061496.064658:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789061496.064854:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a47c2b480 x1875966779498368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061496.064891:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779498368:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789061496.707203:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061497.574349:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061497.574403:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061497.574434:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758494336 00000100:00100000:2.0:1789061497.574443:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758494336 00000100:00100000:2.0:1789061497.574502:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 201 00000100:00100000:2.0:1789061497.574511:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2356:x1875966758494336:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061497.574578:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2356:x1875966758494336:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 69us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061497.574585:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 201 00000100:00100000:1.0:1789061497.574821:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758494464 00000100:00100000:1.0:1789061497.574826:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758494464 00000100:00100000:1.0:1789061497.574875:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1789061497.574882:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758494464:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061497.574917:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758494464:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061497.574923:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00080000:2.0:1789061497.575290:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1789061497.580405:0:9267:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:0.0:1789061497.725935:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061498.630074:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779498496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061498.630177:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061498.630300:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779498496 00000100:00100000:1.0:1789061498.630311:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779498496 00000100:00100000:1.0:1789061498.630392:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789061498.630403:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779498496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061498.630455:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061498.630527:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779498496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061498.630535:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789061498.630587:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7613c000 x1875966779498496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061498.630612:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779498496:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789061498.631237:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789061498.753407:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061499.773761:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061500.670173:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779498624:0@lo:400:kworker.0 00000100:00100000:1.0:1789061500.670277:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061500.670349:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779499136:0@lo:400:kworker.0 00000100:00100000:1.0:1789061500.670381:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061500.670427:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061500.670433:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779499008:0@lo:400:kworker.0 00000100:00100000:1.0:1789061500.670461:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061500.670542:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779498752:0@lo:400:kworker.0 00000100:00100000:1.0:1789061500.670569:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061500.670587:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779499264:0@lo:400:kworker.0 00000100:00100000:1.0:1789061500.670635:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061500.670656:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061500.670662:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779498880:0@lo:400:kworker.0 00000100:00100000:1.0:1789061500.670697:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061500.670732:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779499136 00000100:00100000:1.0:1789061500.670742:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779499136 00000100:00100000:1.0:1789061500.670817:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779498752 00000100:00100000:1.0:1789061500.670821:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779498752 00000100:00100000:1.0:1789061500.670836:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779498880 00000100:00100000:1.0:1789061500.670838:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779498880 00000100:00100000:1.0:1789061500.670857:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789061500.670866:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779499136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061500.670930:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779499136:12345-0@lo:400:kworker.0 Request processed in 64us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061500.671157:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789061500.671180:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789061500.671187:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779498752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061500.671225:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779498752:12345-0@lo:400:kworker.0 Request processed in 39us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061500.671231:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789061500.671242:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789061500.671248:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779498880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061500.671274:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779498880:12345-0@lo:400:kworker.0 Request processed in 27us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061500.671280:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789061500.671303:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779499008 00000100:00100000:1.0:1789061500.671307:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779499008 00000100:00100000:1.0:1789061500.671335:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779499264 00000100:00100000:1.0:1789061500.671339:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779499264 00000100:00100000:1.0:1789061500.671360:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789061500.671366:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779499008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061500.671410:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779499008:12345-0@lo:400:kworker.0 Request processed in 44us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061500.671426:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789061500.671439:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789061500.671445:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779499264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061500.671473:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779499264:12345-0@lo:400:kworker.0 Request processed in 28us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061500.671478:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789061500.671586:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779498880:0@lo:400:kworker.0 00000100:00100000:1.0:1789061500.671599:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779498752:0@lo:400:kworker.0 00010000:00080000:1.0:1789061500.671613:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1e9180 x1875966779499264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061500.671635:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779499264:0@lo:400:kworker.0 00010000:00080000:1.0:1789061500.671777:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1eb800 x1875966779499008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061500.671789:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779499008:0@lo:400:kworker.0 00000100:00100000:1.0:1789061500.671801:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779499136:0@lo:400:kworker.0 00000100:00080000:2.0:1789061500.672129:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061500.672136:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061500.672139:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061500.672484:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779498624 00000100:00100000:3.0:1789061500.672536:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779498624 00000100:00100000:3.0:1789061500.672584:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789061500.672592:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779498624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061500.672764:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779498624:12345-0@lo:400:kworker.0 Request processed in 172us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061500.672772:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789061500.672907:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779498624:0@lo:400:kworker.0 00000001:02000400:0.0:1789061500.698848:0:9365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:3.0:1789061500.800927:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061501.181911:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061501.181948:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779499392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061501.182078:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061501.182482:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779499392 00000100:00100000:3.0:1789061501.182527:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779499392 00000100:00100000:3.0:1789061501.182591:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789061501.182601:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779499392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061501.182671:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061501.182741:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779499392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061501.182749:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789061501.182843:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1e8700 x1875966779499392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061501.182869:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779499392:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789061501.823948:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061502.699110:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061502.699436:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061502.699849:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758494592 00000100:00100000:0.0:1789061502.699865:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758494592 00000100:00100000:0.0:1789061502.699938:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:0.0:1789061502.699957:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2354:x1875966758494592:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061502.700069:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2354:x1875966758494592:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 115us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061502.700076:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:1.0:1789061502.700810:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758494720 00000100:00100000:1.0:1789061502.700821:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758494720 00000100:00100000:1.0:1789061502.700973:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:1.0:1789061502.700984:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2353:x1875966758494720:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061502.701046:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2353:x1875966758494720:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 65us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061502.701066:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00080000:3.0:1789061502.701546:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789061502.850605:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789061503.517667:0:9463:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:2.0:1789061503.745930:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061503.745965:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779499520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061503.746060:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061503.746151:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779499520 00000100:00100000:2.0:1789061503.746163:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779499520 00000100:00100000:2.0:1789061503.746235:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789061503.746246:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779499520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061503.746309:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061503.746366:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779499520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061503.746373:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1789061503.746399:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061503.746438:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c606680 x1875966779499520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061503.746459:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779499520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789061503.871482:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061504.893684:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789061505.232947:0:9511:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 10 13:31:42 EDT 2026 00000100:00100000:3.0:1789061505.789937:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779499776:0@lo:400:kworker.0 00000100:00100000:3.0:1789061505.790014:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061505.790087:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779500288:0@lo:400:kworker.0 00000100:00100000:3.0:1789061505.790114:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061505.790145:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061505.790151:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779499904:0@lo:400:kworker.0 00000100:00100000:3.0:1789061505.790173:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061505.790206:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779499776 00000100:00100000:3.0:1789061505.790214:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779499776 00000100:00100000:3.0:1789061505.790256:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779499904 00000100:00100000:3.0:1789061505.790260:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779499904 00000100:00100000:3.0:1789061505.790293:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789061505.790301:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779499776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061505.790354:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779499776:12345-0@lo:400:kworker.0 Request processed in 52us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061505.790375:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789061505.790392:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789061505.790398:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779499904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061505.790428:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779499904:12345-0@lo:400:kworker.0 Request processed in 30us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061505.790433:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1789061505.790449:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061505.790478:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779499904:0@lo:400:kworker.0 00000100:00100000:3.0:1789061505.790511:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779499776:0@lo:400:kworker.0 00000100:00100000:0.0:1789061505.790610:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779500032:0@lo:400:kworker.0 00000100:00100000:0.0:1789061505.790641:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061505.790669:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789061505.790675:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779499648:0@lo:400:kworker.0 00000100:00100000:0.0:1789061505.790702:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061505.790727:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779500160:0@lo:400:kworker.0 00000100:00100000:0.0:1789061505.790751:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061505.790777:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779500160 00000100:00100000:0.0:1789061505.790781:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779500160 00000100:00100000:0.0:1789061505.790809:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789061505.790815:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779500160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061505.790851:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779500160:12345-0@lo:400:kworker.0 Request processed in 36us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061505.790857:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789061505.790875:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779499648 00000100:00100000:0.0:1789061505.790878:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779499648 00000100:00100000:0.0:1789061505.790900:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789061505.790906:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779499648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061505.790934:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779499648:12345-0@lo:400:kworker.0 Request processed in 29us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061505.790940:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789061505.790982:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779499648:0@lo:400:kworker.0 00000100:00100000:0.0:1789061505.790993:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779500160:0@lo:400:kworker.0 00000100:00100000:3.0:1789061505.791076:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779500288 00000100:00100000:3.0:1789061505.791080:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779500288 00000100:00100000:3.0:1789061505.791106:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779500032 00000100:00100000:3.0:1789061505.791108:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779500032 00000100:00100000:3.0:1789061505.791128:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789061505.791134:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779500288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061505.791172:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779500288:12345-0@lo:400:kworker.0 Request processed in 37us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061505.791178:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789061505.791190:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789061505.791196:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779500032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061505.791226:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779500032:12345-0@lo:400:kworker.0 Request processed in 30us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061505.791231:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789061505.791245:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789061505.791248:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061505.791257:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789061505.791280:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1ef480 x1875966779500288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061505.791292:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779500288:0@lo:400:kworker.0 00010000:00080000:0.0:1789061505.791363:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1ec380 x1875966779500032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061505.791373:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779500032:0@lo:400:kworker.0 00010000:00010000:0.0:1789061505.917825:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061506.302070:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779500416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061506.302305:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061506.302384:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779500416 00000100:00100000:2.0:1789061506.302395:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779500416 00000100:00100000:2.0:1789061506.302464:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789061506.302475:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779500416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789061506.302547:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061506.302747:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779500416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 274us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061506.302756:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789061506.303328:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1e9f80 x1875966779500416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061506.303352:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779500416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789061506.947015:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061507.816382:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061507.816478:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061507.816537:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758494848 00000100:00100000:1.0:1789061507.816547:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758494848 00000100:00100000:1.0:1789061507.816596:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:1.0:1789061507.816606:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2356:x1875966758494848:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061507.816675:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2356:x1875966758494848:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 71us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061507.816683:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:0.0:1789061507.816974:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758494976 00000100:00100000:0.0:1789061507.816979:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758494976 00000100:00100000:0.0:1789061507.817035:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:0.0:1789061507.817043:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758494976:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061507.817086:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758494976:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 44us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061507.817093:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00080000:1.0:1789061507.819114:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789061507.965746:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061508.863864:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061508.863897:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779500544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061508.863992:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061508.864077:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779500544 00000100:00100000:2.0:1789061508.864100:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779500544 00000100:00100000:2.0:1789061508.864178:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789061508.864189:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779500544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061508.864238:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061508.864293:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779500544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061508.864311:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789061508.864340:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061508.864380:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c606680 x1875966779500544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061508.864402:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779500544:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789061508.993032:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061510.014650:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061510.912389:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779501056:0@lo:400:kworker.0 00000100:00100000:1.0:1789061510.912651:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779500928:0@lo:400:kworker.0 00000100:00100000:1.0:1789061510.912711:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061510.913002:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061510.918022:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779500800:0@lo:400:kworker.0 00000100:00100000:3.0:1789061510.918129:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061510.918204:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779501056 00000100:00100000:3.0:1789061510.918216:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779501056 00000100:00100000:3.0:1789061510.918305:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789061510.918316:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779501056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061510.918379:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779501056:12345-0@lo:400:kworker.0 Request processed in 65us (5376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061510.918386:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789061510.918637:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779500672:0@lo:400:kworker.0 00000100:00100000:3.0:1789061510.918676:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789061510.920149:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061510.921025:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779500672 00000100:00100000:2.0:1789061510.921042:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779500672 00000100:00100000:2.0:1789061510.921124:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789061510.921136:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779500672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061510.924199:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779500928 00000100:00100000:1.0:1789061510.924217:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779500928 00010000:00080000:0.0:1789061510.924217:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7cd2ce00 x1875966779501056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061510.924237:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779501056:0@lo:400:kworker.0 00000100:00100000:1.0:1789061510.924291:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779500800 00000100:00100000:1.0:1789061510.924295:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779500800 00000100:00100000:1.0:1789061510.924322:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789061510.924332:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779500928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061510.927205:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779500672:12345-0@lo:400:kworker.0 Request processed in 6058us (8512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061510.927225:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:2.0:1789061510.927307:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061510.927502:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789061510.927531:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779500800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061510.927598:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779500800:12345-0@lo:400:kworker.0 Request processed in 86us (9470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061510.927605:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789061510.927668:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779500800:0@lo:400:kworker.0 00000100:00100000:2.0:1789061510.927684:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779501312:0@lo:400:kworker.0 00000100:00100000:2.0:1789061510.927736:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061510.928347:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779501312 00000100:00100000:2.0:1789061510.928357:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779501312 00000100:00100000:2.0:1789061510.928443:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789061510.928452:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779501312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061510.928621:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779500672:0@lo:400:kworker.0 00000100:00100000:3.0:1789061510.928633:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779501184:0@lo:400:kworker.0 00000100:00100000:3.0:1789061510.928669:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061510.929219:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779500928:12345-0@lo:400:kworker.0 Request processed in 4885us (16504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061510.929231:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789061510.929253:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779501184 00000100:00100000:1.0:1789061510.929258:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779501184 00000100:00100000:1.0:1789061510.929290:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789061510.929297:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779501184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061510.929361:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779501184:12345-0@lo:400:kworker.0 Request processed in 52us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061510.929368:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789061510.929450:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779501184:0@lo:400:kworker.0 00000100:00080000:3.0:1789061510.929483:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061510.930871:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779500928:0@lo:400:kworker.0 00000100:00080000:3.0:1789061510.931016:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061510.931371:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779501312:12345-0@lo:400:kworker.0 Request processed in 2917us (3631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061510.931464:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789061510.931513:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7cd2e680 x1875966779501312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061510.931542:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779501312:0@lo:400:kworker.0 00010000:00010000:3.0:1789061511.037687:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061511.422435:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061511.422466:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779501440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061511.422558:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061511.422859:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779501440 00000100:00100000:1.0:1789061511.422870:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779501440 00000100:00100000:1.0:1789061511.422930:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789061511.422941:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779501440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061511.422977:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061511.423028:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779501440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061511.423035:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789061511.423122:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1ece00 x1875966779501440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061511.423142:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779501440:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789061512.070760:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061512.937664:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061512.937717:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061512.937751:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758495232 00000100:00100000:1.0:1789061512.937760:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758495232 00000100:00100000:1.0:1789061512.937814:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:1.0:1789061512.937823:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2354:x1875966758495232:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061512.937896:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2354:x1875966758495232:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 73us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061512.937903:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00080000:1.0:1789061512.937924:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061512.939035:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758495104 00000100:00100000:3.0:1789061512.939045:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758495104 00000100:00100000:3.0:1789061512.939089:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00100000:3.0:1789061512.939097:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2354:x1875966758495104:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061512.939147:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2354:x1875966758495104:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 51us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061512.939154:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 207 00010000:00010000:2.0:1789061513.086658:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061513.982719:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779501568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061513.982793:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061513.982906:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779501568 00000100:00100000:1.0:1789061513.982914:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779501568 00000100:00100000:1.0:1789061513.982989:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789061513.982999:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779501568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061513.983035:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061513.983086:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779501568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061513.983094:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789061513.983151:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789061513.983186:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1eed80 x1875966779501568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061513.983206:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779501568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789061514.110055:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061515.142973:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061516.029765:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779501696:0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.029850:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061516.029909:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779502208:0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.029935:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061516.029959:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061516.029965:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779502080:0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.029987:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061516.030014:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779501824:0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.030035:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061516.030050:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779502336:0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.030068:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061516.030084:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061516.030096:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779501952:0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.030132:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061516.030165:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779501696 00000100:00100000:0.0:1789061516.030172:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779501696 00000100:00100000:0.0:1789061516.030219:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789061516.030228:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779501696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.030277:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779501696:12345-0@lo:400:kworker.0 Request processed in 50us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061516.030285:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789061516.030339:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779502208 00000100:00100000:0.0:1789061516.030344:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779502208 00000100:00100000:0.0:1789061516.030780:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779501824 00000100:00100000:0.0:1789061516.030786:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779501824 00000100:00100000:0.0:1789061516.030799:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779501952 00000100:00100000:0.0:1789061516.030801:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779501952 00000100:00100000:0.0:1789061516.030815:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789061516.030821:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779502208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.030860:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779502208:12345-0@lo:400:kworker.0 Request processed in 39us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061516.030866:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789061516.030892:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789061516.030898:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779501824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.030929:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779501824:12345-0@lo:400:kworker.0 Request processed in 31us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061516.030934:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789061516.030946:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789061516.030952:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779501952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.030993:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779501952:12345-0@lo:400:kworker.0 Request processed in 41us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061516.030999:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789061516.031020:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779502080 00000100:00100000:0.0:1789061516.031023:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779502080 00000100:00100000:0.0:1789061516.031047:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779502336 00000100:00100000:0.0:1789061516.031050:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779502336 00000100:00100000:0.0:1789061516.031067:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789061516.031073:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779502080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.031115:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779502080:12345-0@lo:400:kworker.0 Request processed in 42us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061516.031120:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789061516.031131:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789061516.031136:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779502336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.031162:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779502336:12345-0@lo:400:kworker.0 Request processed in 27us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061516.031168:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789061516.031200:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061516.031204:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789061516.031207:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061516.031239:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779501952:0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.031251:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779501824:0@lo:400:kworker.0 00010000:00080000:0.0:1789061516.031261:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75ef6d80 x1875966779502336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061516.031270:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779502336:0@lo:400:kworker.0 00010000:00080000:0.0:1789061516.031318:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7cd2ca80 x1875966779502080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061516.033243:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779502080:0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.033283:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779501696:0@lo:400:kworker.0 00000100:00100000:0.0:1789061516.033301:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779502208:0@lo:400:kworker.0 00010000:00010000:0.0:1789061516.157835:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061516.546023:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061516.546054:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779502464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061516.546152:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061516.548179:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779502464 00000100:00100000:0.0:1789061516.548198:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779502464 00000100:00100000:0.0:1789061516.548279:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789061516.548291:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779502464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061516.548355:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061516.548820:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779502464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 531us (2668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061516.548828:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789061516.548936:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75ef5500 x1875966779502464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061516.548976:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779502464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789061517.183218:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061518.052590:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061518.052655:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061518.052761:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758495488 00000100:00100000:0.0:1789061518.052774:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758495488 00000100:00100000:0.0:1789061518.052866:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:0.0:1789061518.052880:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2353:x1875966758495488:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061518.052981:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2353:x1875966758495488:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 104us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061518.052989:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00080000:3.0:1789061518.053200:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061518.054094:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758495360 00000100:00100000:2.0:1789061518.054106:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758495360 00000100:00100000:2.0:1789061518.054157:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:2.0:1789061518.054166:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2353:x1875966758495360:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061518.054258:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2353:x1875966758495360:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 92us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061518.054266:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 209 00010000:00010000:1.0:1789061518.205809:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061519.103777:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061519.103813:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779502592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061519.103923:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061519.104018:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779502592 00000100:00100000:1.0:1789061519.104038:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779502592 00000100:00100000:1.0:1789061519.104112:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789061519.104124:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779502592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061519.104173:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061519.104245:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779502592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061519.104252:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789061519.104290:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061519.104330:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1eea00 x1875966779502592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061519.104354:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779502592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789061519.233657:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061520.255403:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061521.151612:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779502720:0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.151721:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061521.151787:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779503232:0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.151819:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061521.151870:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061521.151876:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779503104:0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.151902:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061521.151936:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779502848:0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.151962:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061521.151982:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779503360:0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.152001:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061521.152018:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061521.152022:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779502976:0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.152040:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061521.152073:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779502720 00000100:00100000:1.0:1789061521.152083:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779502720 00000100:00100000:1.0:1789061521.152134:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789061521.152143:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779502720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.152198:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779502720:12345-0@lo:400:kworker.0 Request processed in 56us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061521.152204:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789061521.152254:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779503232 00000100:00100000:1.0:1789061521.152258:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779503232 00000100:00100000:1.0:1789061521.152295:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779502848 00000100:00100000:1.0:1789061521.152298:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779502848 00000100:00100000:1.0:1789061521.152307:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779502976 00000100:00100000:1.0:1789061521.152309:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779502976 00000100:00100000:1.0:1789061521.152322:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789061521.152327:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779503232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.152358:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779503232:12345-0@lo:400:kworker.0 Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061521.152364:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789061521.152393:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789061521.152399:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779502848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.152436:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779502848:12345-0@lo:400:kworker.0 Request processed in 37us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061521.152442:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789061521.152454:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789061521.152460:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779502976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.152511:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779502976:12345-0@lo:400:kworker.0 Request processed in 29us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061521.152517:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789061521.152534:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779503104 00000100:00100000:1.0:1789061521.152537:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779503104 00000100:00100000:1.0:1789061521.152561:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779503360 00000100:00100000:1.0:1789061521.152563:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779503360 00000100:00100000:1.0:1789061521.152581:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789061521.152587:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779503104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.152620:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779503104:12345-0@lo:400:kworker.0 Request processed in 33us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061521.152626:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789061521.152637:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789061521.152642:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779503360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.152665:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779503360:12345-0@lo:400:kworker.0 Request processed in 24us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061521.152670:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789061521.152699:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061521.152704:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061521.152707:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061521.152768:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779502976:0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.152782:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779502848:0@lo:400:kworker.0 00010000:00080000:1.0:1789061521.152795:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1ece00 x1875966779503360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061521.152806:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779503360:0@lo:400:kworker.0 00010000:00080000:1.0:1789061521.152853:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1ed880 x1875966779503104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061521.152862:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779503104:0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.152870:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779502720:0@lo:400:kworker.0 00000100:00100000:1.0:1789061521.152878:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779503232:0@lo:400:kworker.0 00010000:00010000:3.0:1789061521.278884:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061521.665031:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779503488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061521.665147:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061521.666910:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779503488 00000100:00100000:3.0:1789061521.666935:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779503488 00000100:00100000:3.0:1789061521.667011:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789061521.667023:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779503488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061521.667078:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061521.667193:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779503488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061521.667201:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789061521.667293:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1eaa00 x1875966779503488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061521.667321:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779503488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789061522.303431:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061523.175867:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061523.175930:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061523.176027:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758495616 00000100:00100000:1.0:1789061523.176031:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758495744 00000100:00100000:2.0:1789061523.176041:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758495616 00000100:00100000:1.0:1789061523.176041:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758495744 00000100:00100000:2.0:1789061523.176115:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:2.0:1789061523.176128:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2354:x1875966758495616:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061523.176217:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1789061523.176225:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2354:x1875966758495744:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061523.176237:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2354:x1875966758495616:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 112us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061523.176245:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:1.0:1789061523.176259:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2354:x1875966758495744:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 37us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061523.176265:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00080000:3.0:1789061523.177229:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789061523.326086:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061524.224625:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779503616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061524.224730:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061524.224860:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779503616 00000100:00100000:2.0:1789061524.224873:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779503616 00000100:00100000:2.0:1789061524.224952:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789061524.224964:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779503616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061524.225014:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061524.225068:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779503616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061524.225076:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789061524.225103:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061524.225143:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c604e00 x1875966779503616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061524.225178:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779503616:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789061524.300189:0:10142:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 13:32:01 (1789061521) === 00010000:00010000:0.0:1789061524.350678:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061524.698771:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061524.698896:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758495872 00000100:00100000:1.0:1789061524.698910:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758495872 00000100:00100000:1.0:1789061524.698985:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:1.0:1789061524.698998:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:8145:x1875966758495872:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789061524.699020:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061524.699068:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c524a00/0x427fa11dc4a9a7d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca89f82 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061524.699106:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c524a00/0x427fa11dc4a9a7d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f82 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061524.699119:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c524a00/0x427fa11dc4a9a7d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f82 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061524.699129:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524a00, rc 0) 00000100:00100000:1.0:1789061524.699221:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+11:8145:x1875966758495872:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 226us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061524.699229:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:2.0:1789061524.714093:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061524.720353:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758496000 00000100:00100000:0.0:1789061524.720374:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758496000 00000100:00100000:0.0:1789061524.720471:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:0.0:1789061524.720937:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+11:8145:x1875966758496000:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789061524.722373:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+11:8145:x1875966758496000:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 1432us (8281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061524.722390:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:3.0:1789061524.725638:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061524.725815:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758496128 00000100:00100000:0.0:1789061524.725830:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758496128 00000100:00100000:0.0:1789061524.725903:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:0.0:1789061524.725914:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+11:8145:x1875966758496128:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789061524.726338:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+11:8145:x1875966758496128:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 298us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061524.726350:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:2.0:1789061524.731727:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061524.737447:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758496256 00000100:00100000:0.0:1789061524.737469:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758496256 00000100:00100000:1.0:1789061524.740108:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:1.0:1789061524.740140:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+11:8149:x1875966758496256:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789061524.740585:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+11:8149:x1875966758496256:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 459us (8873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061524.740595:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:2.0:1789061524.760072:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061524.763341:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758496384 00000100:00100000:0.0:1789061524.763435:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758496384 00000100:00100000:2.0:1789061524.772524:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:2.0:1789061524.772557:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+11:8149:x1875966758496384:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789061524.773744:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+11:8149:x1875966758496384:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 1195us (13680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061524.773757:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:3.0:1789061524.784040:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061524.784832:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758496512 00000100:00100000:1.0:1789061524.784848:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758496512 00000100:00100000:1.0:1789061524.784930:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:1.0:1789061524.784942:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+11:8145:x1875966758496512:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789061524.784966:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061524.784988:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c525000/0x427fa11dc4a9a7d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca89fac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061524.785027:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c525000/0x427fa11dc4a9a7d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fac expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061524.785059:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c525000/0x427fa11dc4a9a7d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fac expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061524.785069:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525000, rc 0) 00000100:00100000:1.0:1789061524.787436:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+12:8145:x1875966758496512:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 2477us (3394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061524.787454:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:2.0:1789061524.791046:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061524.791775:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758496640 00000100:00100000:3.0:1789061524.791792:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758496640 00000100:00100000:3.0:1789061524.791902:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:3.0:1789061524.791915:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+12:8145:x1875966758496640:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789061524.791950:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789061524.791985:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789061524.791990:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789061524.791993:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789061524.791996:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789061524.794122:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+12:8145:x1875966758496640:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 2196us (3079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061524.794141:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:0.0:1789061524.798986:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061524.799110:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758496768 00000100:00100000:1.0:1789061524.799197:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758496768 00000100:00100000:1.0:1789061524.799336:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:1.0:1789061524.799351:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+12:8145:x1875966758496768:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789061524.799377:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061524.799403:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c525800/0x427fa11dc4a9a7e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca89fb3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061524.799443:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c525800/0x427fa11dc4a9a7e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fb3 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061524.799457:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c525800/0x427fa11dc4a9a7e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fb3 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061524.799470:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525800, rc 0) 00000100:00100000:1.0:1789061524.799701:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:8145:x1875966758496768:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 353us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061524.799709:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:2.0:1789061524.802810:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061524.802998:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758496896 00000100:00100000:3.0:1789061524.803012:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758496896 00000100:00100000:3.0:1789061524.803102:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:3.0:1789061524.803113:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:8145:x1875966758496896:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789061524.804051:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:8145:x1875966758496896:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 932us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061524.804063:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:3.0:1789061524.806869:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061524.807028:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758497024 00000100:00100000:1.0:1789061524.807058:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758497024 00000100:00100000:1.0:1789061524.807201:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:1.0:1789061524.807225:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:8145:x1875966758497024:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789061524.807562:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:8145:x1875966758497024:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 350us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061524.807573:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:0.0:1789061524.812902:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061524.813033:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758497152 00000100:00100000:3.0:1789061524.813049:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758497152 00000100:00100000:3.0:1789061524.813132:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 222 00000100:00100000:3.0:1789061524.813146:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:8151:x1875966758497152:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789061524.814026:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:8151:x1875966758497152:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 878us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061524.814038:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 222 00000100:00100000:0.0:1789061524.819016:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061524.819132:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758497280 00000100:00100000:1.0:1789061524.819146:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758497280 00000100:00100000:1.0:1789061524.819247:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 223 00000100:00100000:1.0:1789061524.819261:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:8151:x1875966758497280:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789061524.819830:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:8151:x1875966758497280:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 570us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061524.819854:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 223 00000100:00100000:0.0:1789061524.827706:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061524.827754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061524.827860:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758497792 00000100:00100000:2.0:1789061524.827861:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758497408 00000100:00100000:2.0:1789061524.827874:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758497408 00000100:00100000:1.0:1789061524.827874:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758497792 00000100:00100000:2.0:1789061524.828009:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1789061524.828022:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758497792:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061524.828130:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758497792:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 111us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061524.828138:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1789061524.828180:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1789061524.828185:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1875966758497408:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789061524.828224:0:5851:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 49f27ef9-7067-4c53-ba32-5835a74a1c61@192.168.204.54@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:2.0:1789061524.828274:0:5851:0:(genops.c:1384:class_connect()) connect: client 49f27ef9-7067-4c53-ba32-5835a74a1c61, cookie 0x427fa11dc4a9a7e7 00000004:00100000:2.0:1789061524.828316:0:5851:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789061524.828707:0:5851:0:(import.c:65:import_set_state_nolock()) ffff971a7cade800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789061524.828747:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:2352:x1875966758497408:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 560us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061524.828755:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1789061524.831442:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061524.840792:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758497536 00000100:00100000:1.0:1789061524.840815:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758497536 00000100:00100000:1.0:1789061524.840927:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1789061524.840941:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:0:x1875966758497536:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789061524.841001:0:8391:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789061524.842809:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:0:x1875966758497536:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 1858us (11364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061524.842826:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00080000:2.0:1789061524.845406:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061524.845981:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061524.846201:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758497664 00000100:00100000:1.0:1789061524.846214:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758497664 00000100:00100000:1.0:1789061524.846755:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1789061524.846790:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:8145:x1875966758497664:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789061524.846843:0:8391:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789061524.847002:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:8145:x1875966758497664:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 219us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061524.847011:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1789061524.850099:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061524.850339:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758497920 00000100:00100000:0.0:1789061524.850352:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758497920 00000100:00100000:0.0:1789061524.850701:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1789061524.850713:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:8145:x1875966758497920:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789061524.850821:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:8145:x1875966758497920:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 111us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061524.850829:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1789061524.853835:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061524.853879:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061524.853920:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061524.853984:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758498048 00000100:00100000:1.0:1789061524.854003:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758498048 00000100:00100000:1.0:1789061524.854073:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758498176 00000100:00100000:1.0:1789061524.854076:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758498176 00000100:00100000:1.0:1789061524.854107:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1789061524.854128:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875966758498048:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789061524.854185:0:8285:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 49f27ef9-7067-4c53-ba32-5835a74a1c61@192.168.204.54@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:1.0:1789061524.854252:0:8285:0:(genops.c:1384:class_connect()) connect: client 49f27ef9-7067-4c53-ba32-5835a74a1c61, cookie 0x427fa11dc4a9a7ee 00002000:00100000:1.0:1789061524.854269:0:8285:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 49f27ef9-7067-4c53-ba32-5835a74a1c61/ffff971a4d6da000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789061524.854286:0:8285:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789061524.854840:0:8285:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789061524.854890:0:8285:0:(import.c:65:import_set_state_nolock()) ffff971a4d6db800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061524.854985:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:2352:x1875966758498048:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 866us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061524.854994:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1789061524.855026:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1789061524.855031:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875966758498176:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789061524.855053:0:8285:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 49f27ef9-7067-4c53-ba32-5835a74a1c61@192.168.204.54@tcp t0 exp 0000000000000000 cur 299 last 0 00000100:00100000:0.0:1789061524.856028:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758498304 00000100:00100000:0.0:1789061524.856040:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758498304 00000100:00100000:0.0:1789061524.856188:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1789061524.856199:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:8145:x1875966758498304:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789061524.856311:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789061524.856399:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:8145:x1875966758498304:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 202us (2574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061524.856407:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000020:00000080:1.0:1789061524.856653:0:8285:0:(genops.c:1384:class_connect()) connect: client 49f27ef9-7067-4c53-ba32-5835a74a1c61, cookie 0x427fa11dc4a9a7f5 00002000:00100000:1.0:1789061524.856685:0:8285:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 49f27ef9-7067-4c53-ba32-5835a74a1c61/ffff971a4d6d9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789061524.856813:0:8285:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789061524.857064:0:8285:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789061524.857100:0:8285:0:(import.c:65:import_set_state_nolock()) ffff971a4d6de000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061524.859544:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:2352:x1875966758498176:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 2194us (3306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061524.859991:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00010000:00010000:3.0:1789061525.374093:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061526.275092:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779503744:0@lo:400:kworker.0 00000100:00100000:2.0:1789061526.275155:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779504128:0@lo:400:kworker.0 00000100:00100000:0.0:1789061526.275172:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061526.275186:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061526.275231:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779504256:0@lo:400:kworker.0 00000100:00100000:0.0:1789061526.275258:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061526.275292:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779504256 00000100:00100000:0.0:1789061526.275298:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779504256 00000100:00100000:0.0:1789061526.275353:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789061526.275362:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779504256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061526.275413:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779504256:12345-0@lo:400:kworker.0 Request processed in 51us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061526.275419:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1789061526.275459:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061526.275524:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779504256:0@lo:400:kworker.0 00000100:00100000:3.0:1789061526.277609:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779503872:0@lo:400:kworker.0 00000100:00100000:3.0:1789061526.277674:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061526.277705:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779504384:0@lo:400:kworker.0 00000100:00100000:3.0:1789061526.277728:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061526.277749:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061526.277753:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779503872 00000100:00100000:3.0:1789061526.277756:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779504000:0@lo:400:kworker.0 00000100:00100000:2.0:1789061526.277761:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779503872 00000100:00100000:3.0:1789061526.277786:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061526.277801:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779504000 00000100:00100000:2.0:1789061526.277804:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779504000 00000100:00100000:3.0:1789061526.277825:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779503744 00000100:00100000:3.0:1789061526.277829:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779503744 00000100:00100000:2.0:1789061526.277847:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789061526.277852:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789061526.277856:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779503872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061526.277857:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779503744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061526.277901:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779503744:12345-0@lo:400:kworker.0 Request processed in 42us (2728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061526.277901:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779503872:12345-0@lo:400:kworker.0 Request processed in 46us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061526.277909:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789061526.277909:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789061526.277924:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789061526.277930:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779504000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061526.277936:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779504128 00000100:00100000:3.0:1789061526.277939:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779504128 00000100:00100000:2.0:1789061526.277955:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779504000:12345-0@lo:400:kworker.0 Request processed in 25us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061526.277960:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789061526.277963:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779504384 00000100:00100000:3.0:1789061526.277965:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779504384 00000100:00100000:3.0:1789061526.277983:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789061526.277989:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779504128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061526.278028:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779504128:12345-0@lo:400:kworker.0 Request processed in 40us (2841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061526.278033:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789061526.278044:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789061526.278049:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779504384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061526.278074:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779504384:12345-0@lo:400:kworker.0 Request processed in 26us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061526.278079:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789061526.278206:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75cb3100 x1875966779504128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061526.278221:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779504128:0@lo:400:kworker.0 00000100:00100000:3.0:1789061526.278320:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779504000:0@lo:400:kworker.0 00000100:00100000:3.0:1789061526.278330:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779503872:0@lo:400:kworker.0 00010000:00080000:3.0:1789061526.278338:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971946c61f80 x1875966779504384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061526.278359:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779504384:0@lo:400:kworker.0 00000100:00100000:3.0:1789061526.278401:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779503744:0@lo:400:kworker.0 00000100:00080000:1.0:1789061526.281633:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061526.281642:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061526.281645:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789061526.400149:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061526.782702:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061526.782726:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779504512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061526.782793:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061526.782852:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779504512 00000100:00100000:1.0:1789061526.782859:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779504512 00000100:00100000:1.0:1789061526.782903:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789061526.782911:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779504512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061526.782946:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061526.783562:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779504512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 648us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061526.783572:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789061526.783624:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1eea00 x1875966779504512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061526.783643:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779504512:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789061526.836391:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 49f27ef9-7067-4c53-ba32-5835a74a1c61 00000001:00100000:0.0:1789061527.330353:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 49f27ef9-7067-4c53-ba32-5835a74a1c61 00010000:00010000:2.0:1789061527.421909:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789061527.884907:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49f27ef9-7067-4c53-ba32-5835a74a1c61 00010000:00010000:0.0:1789061528.445787:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061529.341721:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779504640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061529.342154:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061529.342620:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779504640 00000100:00100000:1.0:1789061529.342641:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779504640 00000100:00100000:1.0:1789061529.342755:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789061529.342766:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779504640:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789061529.342793:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789061529.342850:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061529.342909:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779504640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061529.342916:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789061529.343015:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971946c60e00 x1875966779504640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061529.343034:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779504640:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789061529.470137:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061530.346794:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061530.346849:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061530.346887:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061530.346918:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061530.346958:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061530.346992:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758498688 00000100:00100000:3.0:1789061530.347003:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758498688 00000100:00100000:2.0:1789061530.347092:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758498432 00000100:00100000:2.0:1789061530.347098:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758498432 00000100:00100000:1.0:1789061530.347144:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758498560 00000100:00100000:1.0:1789061530.347150:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758498560 00000100:00100000:1.0:1789061530.349512:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:1.0:1789061530.349530:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2354:x1875966758498560:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061530.349621:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2354:x1875966758498560:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 98us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061530.349630:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:2.0:1789061530.349739:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:2.0:1789061530.349755:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2354:x1875966758498432:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061530.349802:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2354:x1875966758498432:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 53us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061530.349808:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00080000:1.0:1789061530.353560:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061530.353589:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758498816 00000100:00100000:1.0:1789061530.353600:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758498816 00000100:00100000:1.0:1789061530.353668:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758498944 00000100:00100000:1.0:1789061530.353671:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758498944 00000100:00100000:1.0:1789061530.353695:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:1.0:1789061530.353706:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cfdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2353:x1875966758498816:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061530.353779:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cfdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2353:x1875966758498816:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 76us (6861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061530.353787:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:1.0:1789061530.353970:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1789061530.353977:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2353:x1875966758498944:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061530.354010:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2353:x1875966758498944:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 34us (7052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061530.354016:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00080000:1.0:1789061530.354040:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061530.354043:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061530.360122:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:3.0:1789061530.360138:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2354:x1875966758498688:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061530.360227:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2354:x1875966758498688:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 93us (13377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061530.360235:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00010000:00010000:1.0:1789061530.494996:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789061530.538242:0:10341:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1789061531.389776:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779505024:0@lo:400:kworker.0 00000100:00100000:2.0:1789061531.389848:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061531.389899:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789061531.389904:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779504896:0@lo:400:kworker.0 00000100:00100000:2.0:1789061531.389922:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061531.389938:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779505408:0@lo:400:kworker.0 00000100:00100000:2.0:1789061531.389957:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061531.389988:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779505024 00000100:00100000:2.0:1789061531.389995:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779505024 00000100:00100000:2.0:1789061531.390053:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779504896 00000100:00100000:2.0:1789061531.390056:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779504896 00000100:00100000:2.0:1789061531.390078:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789061531.390086:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779505024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061531.390142:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779505024:12345-0@lo:400:kworker.0 Request processed in 57us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061531.390149:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789061531.390168:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789061531.390174:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779504896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061531.390195:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779504896:12345-0@lo:400:kworker.0 Request processed in 22us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061531.390200:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789061531.390237:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779504896:0@lo:400:kworker.0 00000100:00100000:2.0:1789061531.390246:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779505024:0@lo:400:kworker.0 00000100:00100000:1.0:1789061531.390345:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779505152:0@lo:400:kworker.0 00000100:00100000:1.0:1789061531.390374:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061531.390393:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789061531.390398:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779504768:0@lo:400:kworker.0 00000100:00100000:1.0:1789061531.390423:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061531.390442:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779505280:0@lo:400:kworker.0 00000100:00100000:1.0:1789061531.390461:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061531.390482:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779505280 00000100:00100000:1.0:1789061531.390505:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779505280 00000100:00100000:1.0:1789061531.390529:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789061531.390535:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779505280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061531.390569:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779505280:12345-0@lo:400:kworker.0 Request processed in 33us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061531.390575:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789061531.390595:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779505408 00000100:00100000:1.0:1789061531.390598:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779505408 00000100:00100000:1.0:1789061531.390621:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779505152 00000100:00100000:1.0:1789061531.390623:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779505152 00000100:00100000:1.0:1789061531.390639:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789061531.390645:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779505408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061531.390675:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779505408:12345-0@lo:400:kworker.0 Request processed in 31us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061531.390688:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789061531.390700:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789061531.390707:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779505152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061531.390734:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779505152:12345-0@lo:400:kworker.0 Request processed in 28us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061531.390740:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789061531.390757:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061531.390760:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061531.390763:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061531.390775:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779504768 00000100:00100000:1.0:1789061531.390778:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779504768 00000100:00100000:1.0:1789061531.390801:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789061531.390809:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779504768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061531.390837:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779504768:12345-0@lo:400:kworker.0 Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061531.390843:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789061531.390886:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779504768:0@lo:400:kworker.0 00000100:00100000:1.0:1789061531.390896:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779505280:0@lo:400:kworker.0 00010000:00080000:1.0:1789061531.390907:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971946c60000 x1875966779505152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061531.390917:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779505152:0@lo:400:kworker.0 00010000:00080000:2.0:1789061531.391069:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971946c61c00 x1875966779505408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061531.391078:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779505408:0@lo:400:kworker.0 00010000:00010000:2.0:1789061531.518701:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061531.902273:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061531.902297:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779505536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061531.902378:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061531.902458:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779505536 00000100:00100000:1.0:1789061531.902468:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779505536 00000100:00100000:1.0:1789061531.902535:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789061531.902546:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779505536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061531.902585:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061531.902634:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779505536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061531.902641:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789061531.902682:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d1ed180 x1875966779505536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061531.902703:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779505536:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789061532.547792:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061533.567087:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061534.465465:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779505664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061534.465656:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061534.465777:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779505664 00000100:00100000:0.0:1789061534.465785:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779505664 00000100:00100000:0.0:1789061534.465884:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789061534.465894:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779505664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061534.465931:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061534.465991:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779505664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061534.465998:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1789061534.466039:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789061534.466111:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971946c61c00 x1875966779505664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061534.466129:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779505664:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789061534.590125:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061535.463912:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061535.464003:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061535.464032:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061535.464055:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061535.464077:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061535.464106:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758499200 00000100:00100000:1.0:1789061535.464118:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758499200 00000100:00100000:1.0:1789061535.464177:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758499328 00000100:00100000:1.0:1789061535.464181:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758499328 00000100:00100000:1.0:1789061535.464205:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:1.0:1789061535.464214:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758499200:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061535.464283:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758499200:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 71us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061535.464290:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:1.0:1789061535.464307:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:1.0:1789061535.464321:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758499328:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061535.464346:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758499328:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061535.464351:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:1.0:1789061535.464370:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758499456 00000100:00100000:1.0:1789061535.464373:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758499456 00000100:00100000:1.0:1789061535.464399:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758499584 00000100:00100000:1.0:1789061535.464401:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758499584 00000100:00100000:1.0:1789061535.464420:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1789061535.464426:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758499456:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061535.464451:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758499456:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061535.464457:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1789061535.464469:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1789061535.464475:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758499584:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061535.464524:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758499584:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 49us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061535.464530:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1789061535.464547:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758499072 00000100:00100000:1.0:1789061535.464551:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758499072 00000100:00100000:1.0:1789061535.464582:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 227 00000100:00100000:1.0:1789061535.464589:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758499072:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061535.464613:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758499072:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061535.464618:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 227 00000100:00080000:1.0:1789061535.464657:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061535.464661:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061535.464664:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789061535.613670:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061536.510731:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779506176:0@lo:400:kworker.0 00000100:00100000:1.0:1789061536.510807:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779505920:0@lo:400:kworker.0 00000100:00100000:3.0:1789061536.510834:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061536.510851:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061536.510911:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779506432:0@lo:400:kworker.0 00000100:00100000:3.0:1789061536.510925:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789061536.510945:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779505792:0@lo:400:kworker.0 00000100:00100000:1.0:1789061536.510955:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061536.510992:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061536.510992:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061536.511002:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779506048:0@lo:400:kworker.0 00000100:00100000:3.0:1789061536.511028:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779506304:0@lo:400:kworker.0 00000100:00100000:1.0:1789061536.511036:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061536.511062:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061536.511083:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779505920 00000100:00100000:1.0:1789061536.511093:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779505920 00000100:00100000:1.0:1789061536.511138:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779506048 00000100:00100000:3.0:1789061536.511142:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779505792 00000100:00100000:3.0:1789061536.511148:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779505792 00000100:00100000:1.0:1789061536.511151:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779506048 00000100:00100000:1.0:1789061536.511182:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779506304 00000100:00100000:1.0:1789061536.511185:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779506304 00000100:00100000:3.0:1789061536.511190:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789061536.511202:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779505792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061536.511208:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789061536.511217:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779505920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061536.511258:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779505792:12345-0@lo:400:kworker.0 Request processed in 59us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061536.511266:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789061536.511272:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779505920:12345-0@lo:400:kworker.0 Request processed in 56us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061536.511280:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789061536.511302:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789061536.511454:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779506048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061536.511509:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779506048:12345-0@lo:400:kworker.0 Request processed in 179us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061536.511560:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779506176 00000100:00100000:2.0:1789061536.511564:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779506176 00000100:00100000:2.0:1789061536.511592:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779506432 00000100:00100000:2.0:1789061536.511595:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779506432 00000100:00100000:2.0:1789061536.511614:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789061536.511620:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779506176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061536.511651:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779506176:12345-0@lo:400:kworker.0 Request processed in 31us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061536.511657:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789061536.511671:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789061536.511684:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779506432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061536.511711:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779506432:12345-0@lo:400:kworker.0 Request processed in 28us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061536.511717:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789061536.511780:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779505792:0@lo:400:kworker.0 00010000:00080000:2.0:1789061536.511794:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971946c60700 x1875966779506176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061536.511804:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779506176:0@lo:400:kworker.0 00000100:00080000:2.0:1789061536.511840:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061536.511844:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061536.511846:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061536.511860:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779506048:0@lo:400:kworker.0 00000100:00100000:2.0:1789061536.511867:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779505920:0@lo:400:kworker.0 00010000:00080000:2.0:1789061536.511875:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971946c60380 x1875966779506432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061536.511882:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779506432:0@lo:400:kworker.0 00000100:00100000:3.0:1789061536.515861:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789061536.515892:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779506304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061536.516050:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789061536.516254:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779506304:12345-0@lo:400:kworker.0 Request processed in 378us (5191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061536.516262:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789061536.516330:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779506304:0@lo:400:kworker.0 00010000:00010000:0.0:1789061536.638021:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061537.022002:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779506560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061537.022094:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061537.022261:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779506560 00000100:00100000:3.0:1789061537.022294:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779506560 00000100:00100000:3.0:1789061537.022371:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789061537.022385:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779506560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061537.022520:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061537.022592:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779506560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 209us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061537.022601:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789061537.022751:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d194380 x1875966779506560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061537.022779:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779506560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789061537.670908:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061538.685647:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061539.581651:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779506688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061539.581722:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061539.582153:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779506688 00000100:00100000:1.0:1789061539.582175:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779506688 00000100:00100000:1.0:1789061539.582249:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789061539.582255:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061539.582260:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779506688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061539.582301:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061539.588133:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779506688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5862us (6397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061539.588152:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789061539.593300:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d196300 x1875966779506688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061539.593329:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779506688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789061539.710643:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061540.579818:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061540.579870:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061540.579913:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061540.579940:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758500096 00000100:00100000:1.0:1789061540.579950:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758500096 00000100:00100000:1.0:1789061540.580018:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:1.0:1789061540.580030:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758500096:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061540.581273:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758499840 00000100:00100000:3.0:1789061540.581285:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758499840 00000100:00100000:3.0:1789061540.581342:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:3.0:1789061540.581353:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758499840:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061540.581473:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758500096:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 1445us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061540.581482:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:1.0:1789061540.581524:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758499712 00000100:00100000:1.0:1789061540.581528:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758499712 00000100:00100000:1.0:1789061540.581551:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 229 00000100:00100000:1.0:1789061540.581558:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2355:x1875966758499712:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061540.584894:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758499840:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 3533us (5076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061540.584909:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00080000:3.0:1789061540.584946:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061540.584952:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061540.585427:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2355:x1875966758499712:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 3865us (5510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061540.585437:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 229 00000100:00100000:2.0:1789061540.588986:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061540.589120:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061540.589194:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758500224 00000100:00100000:2.0:1789061540.589205:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758500224 00000100:00100000:2.0:1789061540.589265:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:2.0:1789061540.589275:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758500224:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061540.589344:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758500224:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 70us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061540.589363:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1789061540.589529:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758499968 00000100:00100000:3.0:1789061540.589535:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758499968 00000100:00100000:3.0:1789061540.589606:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:3.0:1789061540.589614:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758499968:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061540.589646:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758499968:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 33us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061540.589653:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00080000:3.0:1789061540.589671:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061540.589675:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789061540.736382:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061541.630888:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779506944:0@lo:400:kworker.0 00000100:00100000:2.0:1789061541.630995:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061541.631051:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779506816:0@lo:400:kworker.0 00000100:00100000:2.0:1789061541.631062:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779507456:0@lo:400:kworker.0 00000100:00100000:2.0:1789061541.631711:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061541.631760:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061541.631767:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779507072:0@lo:400:kworker.0 00000100:00100000:2.0:1789061541.631803:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061541.631850:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779507456 00000100:00100000:2.0:1789061541.631859:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779507456 00000100:00100000:2.0:1789061541.631928:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789061541.631938:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779507456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061541.632011:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779507456:12345-0@lo:400:kworker.0 Request processed in 73us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061541.632019:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789061541.632044:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789061541.632086:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971946c63b80 x1875966779507456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061541.632113:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779507456:0@lo:400:kworker.0 00000100:00100000:2.0:1789061541.632165:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779506944 00000100:00100000:2.0:1789061541.632169:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779506944 00000100:00100000:2.0:1789061541.632200:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779507072 00000100:00100000:2.0:1789061541.632203:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779507072 00000100:00100000:2.0:1789061541.632228:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789061541.632235:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779506944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061541.632296:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779506944:12345-0@lo:400:kworker.0 Request processed in 62us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061541.632303:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789061541.632315:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789061541.632321:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779507072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061541.632349:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779507072:12345-0@lo:400:kworker.0 Request processed in 29us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061541.632354:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789061541.632372:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061541.632389:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779507072:0@lo:400:kworker.0 00000100:00100000:2.0:1789061541.632401:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779506944:0@lo:400:kworker.0 00000100:00100000:0.0:1789061541.643404:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779507200:0@lo:400:kworker.0 00000100:00100000:0.0:1789061541.644752:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061541.653403:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779507200 00000100:00100000:2.0:1789061541.653426:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779507200 00000100:00080000:2.0:1789061541.653475:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061541.653600:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789061541.653615:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779507200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061541.653743:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779507200:12345-0@lo:400:kworker.0 Request processed in 133us (8998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061541.653751:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789061541.653819:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971946c62300 x1875966779507200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061541.653850:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779507200:0@lo:400:kworker.0 00000100:00100000:3.0:1789061541.655419:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061541.655992:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779507328:0@lo:400:kworker.0 00000100:00100000:3.0:1789061541.656071:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061541.656148:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779507328 00000100:00100000:3.0:1789061541.656227:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779507328 00000100:00100000:3.0:1789061541.656300:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789061541.656309:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779507328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061541.656677:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779507328:12345-0@lo:400:kworker.0 Request processed in 367us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061541.656686:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1789061541.656712:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061541.656752:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779507328:0@lo:400:kworker.0 00000100:00100000:2.0:1789061541.659108:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779506816 00000100:00100000:2.0:1789061541.659126:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779506816 00000100:00100000:2.0:1789061541.659212:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789061541.659237:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779506816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061541.659547:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779506816:12345-0@lo:400:kworker.0 Request processed in 312us (28442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061541.659557:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789061541.659631:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779506816:0@lo:400:kworker.0 00010000:00010000:1.0:1789061541.763630:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061542.142465:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779507584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061542.142601:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061542.143339:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779507584 00000100:00100000:1.0:1789061542.143359:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779507584 00000100:00100000:1.0:1789061542.143428:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789061542.143440:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779507584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061542.143529:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061542.143611:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779507584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061542.143619:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789061542.143725:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75ef5f80 x1875966779507584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061542.143748:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779507584:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789061542.782446:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061543.805648:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061544.703275:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779507712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061544.703358:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061544.703581:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779507712 00000100:00100000:3.0:1789061544.703589:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779507712 00000100:00100000:3.0:1789061544.703660:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789061544.703671:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779507712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789061544.703710:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061544.703771:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779507712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061544.703778:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1789061544.704408:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061544.704445:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d195f80 x1875966779507712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061544.704467:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779507712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789061544.829637:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061545.701811:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061545.701846:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061545.701884:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061545.701911:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061545.701948:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758500608 00000100:00100000:2.0:1789061545.701958:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758500608 00000100:00100000:2.0:1789061545.702013:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758500480 00000100:00100000:2.0:1789061545.702016:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758500480 00000100:00100000:2.0:1789061545.702058:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:2.0:1789061545.702068:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2353:x1875966758500608:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061545.702143:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2353:x1875966758500608:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 76us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061545.702151:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:2.0:1789061545.702170:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:2.0:1789061545.702177:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2353:x1875966758500480:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061545.702201:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2353:x1875966758500480:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061545.702207:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00080000:2.0:1789061545.702228:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061545.702465:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758500352 00000100:00100000:3.0:1789061545.702469:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758500352 00000100:00100000:3.0:1789061545.702531:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 231 00000100:00100000:3.0:1789061545.702540:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2353:x1875966758500352:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061545.702573:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2353:x1875966758500352:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061545.702579:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 231 00000100:00100000:3.0:1789061545.702636:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061545.702673:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758500736 00000100:00100000:3.0:1789061545.702677:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758500736 00000100:00100000:3.0:1789061545.702708:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758500864 00000100:00100000:3.0:1789061545.702711:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758500864 00000100:00100000:3.0:1789061545.702732:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1789061545.702750:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2352:x1875966758500736:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:3.0:1789061545.702780:0:8285:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a7ee 00000100:00080000:3.0:1789061545.702791:0:8285:0:(import.c:65:import_set_state_nolock()) ffff971a4d6db800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789061545.702830:0:8285:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789061545.703211:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+2:2352:x1875966758500736:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 460us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061545.703218:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1789061545.703233:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1789061545.703240:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2352:x1875966758500864:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:3.0:1789061545.703251:0:8285:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a7f5 00000100:00080000:3.0:1789061545.703257:0:8285:0:(import.c:65:import_set_state_nolock()) ffff971a4d6de000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789061545.703276:0:8285:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789061545.703470:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+2:2352:x1875966758500864:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 230us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061545.703477:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00080000:3.0:1789061545.703530:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061545.703534:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789061545.705235:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061545.705245:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061545.853706:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061546.750365:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779508224:0@lo:400:kworker.0 00000100:00100000:3.0:1789061546.750442:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061546.750565:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789061546.750572:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779507840:0@lo:400:kworker.0 00000100:00100000:3.0:1789061546.750604:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061546.750632:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779508352:0@lo:400:kworker.0 00000100:00100000:3.0:1789061546.750659:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061546.750715:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779507840 00000100:00100000:3.0:1789061546.750737:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779507840 00000100:00100000:3.0:1789061546.750799:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789061546.750808:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779507840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061546.750860:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779507840:12345-0@lo:400:kworker.0 Request processed in 53us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061546.750866:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789061546.750896:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779508352 00000100:00100000:3.0:1789061546.750900:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779508352 00000100:00100000:3.0:1789061546.750957:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789061546.750965:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779508352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061546.750998:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779508352:12345-0@lo:400:kworker.0 Request processed in 34us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061546.751004:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1789061546.751025:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061546.751060:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779507840:0@lo:400:kworker.0 00000100:00100000:3.0:1789061546.751074:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779508352:0@lo:400:kworker.0 00000100:00100000:1.0:1789061546.751766:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779508224 00000100:00100000:1.0:1789061546.751775:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779508224 00000100:00100000:1.0:1789061546.751817:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789061546.751826:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779508224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061546.751876:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779508224:12345-0@lo:400:kworker.0 Request processed in 53us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061546.751882:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789061546.752143:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779508096:0@lo:400:kworker.0 00000100:00100000:2.0:1789061546.752182:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061546.752215:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789061546.752222:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779507968:0@lo:400:kworker.0 00000100:00100000:2.0:1789061546.752244:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061546.752264:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779508480:0@lo:400:kworker.0 00000100:00100000:2.0:1789061546.752286:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061546.752311:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779508096 00000100:00100000:2.0:1789061546.752316:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779508096 00000100:00100000:2.0:1789061546.752343:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779507968 00000100:00100000:2.0:1789061546.752346:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779507968 00000100:00100000:2.0:1789061546.752362:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789061546.752369:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779508096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061546.752403:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779508096:12345-0@lo:400:kworker.0 Request processed in 35us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061546.752423:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789061546.752437:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789061546.752443:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779507968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061546.752470:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779507968:12345-0@lo:400:kworker.0 Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061546.752475:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789061546.752542:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779507968:0@lo:400:kworker.0 00000100:00100000:2.0:1789061546.752552:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779508096:0@lo:400:kworker.0 00000100:00100000:3.0:1789061546.752676:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779508480 00000100:00100000:3.0:1789061546.752998:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779508480 00000100:00100000:3.0:1789061546.753040:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789061546.753047:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779508480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061546.753215:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779508480:12345-0@lo:400:kworker.0 Request processed in 168us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061546.753223:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789061546.753247:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061546.753252:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061546.753254:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789061546.753282:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c2b4e00 x1875966779508224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061546.753315:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779508224:0@lo:400:kworker.0 00010000:00080000:2.0:1789061546.753533:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971945c92d80 x1875966779508480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061546.753543:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779508480:0@lo:400:kworker.0 00010000:00010000:3.0:1789061546.881315:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061547.263471:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061547.263515:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779508608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061547.263581:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061547.263643:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779508608 00000100:00100000:0.0:1789061547.263650:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779508608 00000100:00100000:0.0:1789061547.263691:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789061547.263699:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779508608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061547.263743:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061547.266519:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779508608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2815us (2932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061547.266531:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789061547.276629:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75ef6680 x1875966779508608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061547.276662:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779508608:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789061547.315072:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 49f27ef9-7067-4c53-ba32-5835a74a1c61 00000020:00000080:1.0:1789061547.315082:0:6725:0:(genops.c:885:class_export_put()) final put ffff971a4d6da000/49f27ef9-7067-4c53-ba32-5835a74a1c61 00000020:00000080:1.0:1789061547.315122:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a4d6da000/49f27ef9-7067-4c53-ba32-5835a74a1c61 for lustre-OST0000 00000020:00000080:1.0:1789061547.315172:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a4d6db800 for lustre-OST0000 00010000:00010000:1.0:1789061547.901662:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789061548.399601:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49f27ef9-7067-4c53-ba32-5835a74a1c61 00000020:00000080:2.0:1789061548.399609:0:7660:0:(genops.c:885:class_export_put()) final put ffff971a4d6d9000/49f27ef9-7067-4c53-ba32-5835a74a1c61 00000020:00000080:0.0:1789061548.403625:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff971a4d6d9000/49f27ef9-7067-4c53-ba32-5835a74a1c61 for lustre-OST0001 00000020:00000080:2.0:1789061548.404192:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a4d6de000 for lustre-OST0001 00010000:00010000:1.0:1789061548.926637:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789061549.019065:0:11044:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789061549.821756:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061549.821780:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779508736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061549.821852:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061549.821983:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779508736 00000100:00100000:0.0:1789061549.821992:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779508736 00000100:00100000:0.0:1789061549.822059:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789061549.822069:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779508736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061549.822105:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061549.822168:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779508736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061549.822175:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1789061549.822540:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061549.823142:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d196d80 x1875966779508736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061549.823163:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779508736:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789061549.950261:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061550.829806:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061550.829849:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061550.829880:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061550.829922:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758501248 00000100:00100000:3.0:1789061550.829933:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758501248 00000100:00100000:3.0:1789061550.829989:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758501120 00000100:00100000:3.0:1789061550.829992:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758501120 00000100:00100000:3.0:1789061550.830025:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:3.0:1789061550.830035:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758501248:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061550.830134:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758501248:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 100us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061550.830142:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:3.0:1789061550.830159:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:3.0:1789061550.830167:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758501120:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061550.830204:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758501120:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 37us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061550.830210:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00080000:3.0:1789061550.830230:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061550.831415:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758500992 00000100:00100000:1.0:1789061550.831435:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758500992 00000100:00100000:1.0:1789061550.831500:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:1.0:1789061550.831511:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2355:x1875966758500992:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061550.831574:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2355:x1875966758500992:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 65us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061550.831581:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 233 00010000:00010000:3.0:1789061550.980189:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061551.872011:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779508864:0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.872122:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061551.872185:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779509376:0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.872218:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061551.872249:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061551.872256:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779509248:0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.872283:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061551.872318:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779508992:0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.872355:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061551.872375:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779509504:0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.872397:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061551.872416:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061551.872422:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779509120:0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.872443:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061551.872481:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779508864 00000100:00100000:2.0:1789061551.872525:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779508864 00000100:00100000:2.0:1789061551.872589:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789061551.872599:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779508864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.872678:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779508864:12345-0@lo:400:kworker.0 Request processed in 80us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061551.872687:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789061551.872746:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779509376 00000100:00100000:2.0:1789061551.872751:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779509376 00000100:00100000:2.0:1789061551.872792:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779508992 00000100:00100000:2.0:1789061551.872796:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779508992 00000100:00100000:2.0:1789061551.872809:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779509120 00000100:00100000:2.0:1789061551.872811:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779509120 00000100:00100000:2.0:1789061551.872829:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789061551.872836:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779509376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.872870:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779509376:12345-0@lo:400:kworker.0 Request processed in 35us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061551.872877:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789061551.872890:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789061551.872896:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779508992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.872929:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779508992:12345-0@lo:400:kworker.0 Request processed in 33us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061551.872942:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789061551.872954:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789061551.872960:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779509120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.872988:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779509120:12345-0@lo:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061551.872993:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789061551.873012:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779509248 00000100:00100000:2.0:1789061551.873016:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779509248 00000100:00100000:2.0:1789061551.873043:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779509504 00000100:00100000:2.0:1789061551.873046:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779509504 00000100:00100000:2.0:1789061551.873068:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789061551.873074:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779509248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.873108:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779509248:12345-0@lo:400:kworker.0 Request processed in 33us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061551.873114:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789061551.873126:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789061551.873132:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779509504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.873162:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779509504:12345-0@lo:400:kworker.0 Request processed in 30us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061551.873167:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1789061551.873223:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9719477df100 x1875966779509248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061551.873240:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779509248:0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.873251:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779508864:0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.873262:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779509376:0@lo:400:kworker.0 00000100:00080000:2.0:1789061551.873301:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061551.873306:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061551.873309:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061551.873332:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779509120:0@lo:400:kworker.0 00000100:00100000:2.0:1789061551.873341:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779508992:0@lo:400:kworker.0 00010000:00080000:2.0:1789061551.873351:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9719477dc700 x1875966779509504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061551.873360:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779509504:0@lo:400:kworker.0 00010000:00010000:3.0:1789061551.998104:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061552.384657:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061552.384689:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779509632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061552.384794:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061552.384882:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779509632 00000100:00100000:2.0:1789061552.384893:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779509632 00000100:00100000:2.0:1789061552.384964:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789061552.384977:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779509632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789061552.385030:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061552.385089:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779509632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061552.385097:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789061552.385153:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9719477dc700 x1875966779509632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061552.385183:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779509632:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1789061552.948262:0:11192:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd865a9ee0 20000000:00000080:2.0:1789061552.948288:0:11192:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff971a7c62d800 uarg=0000000000000000 20000000:01000000:2.0:1789061552.948340:0:11192:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789061552.948354:0:11192:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789061552.948359:0:11192:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789061552.950412:0:11193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789061552.951042:0:11192:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789061552.962215:0:11192:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789061552.962293:0:11192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.962323:0:11192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a7a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f7b expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.962332:0:11192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a7af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a7a8 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.962340:0:11192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9a7bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a7b6 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.962347:0:11192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9a7cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a7c4 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.962355:0:11192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7c525800/0x427fa11dc4a9a7e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fb3 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.962364:0:11192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.963057:0:11192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7c525800/0x427fa11dc4a9a7e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fb3 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.963076:0:11192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a7c525800/0x427fa11dc4a9a7e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fb3 expref: 12 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061552.963094:0:11192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d195c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11192:1875966779509760:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061552.963319:0:11192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9a7cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a7c4 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.963329:0:11192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9a7cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a7c4 expref: 18 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061552.963339:0:11192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d195880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11192:1875966779509888:0@lo:104: 00000100:00100000:3.0:1789061552.963405:0:11192:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789061552.963465:0:11192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9a7bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a7b6 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.963474:0:11192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9a7bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a7b6 expref: 18 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061552.963483:0:11192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d196d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11192:1875966779510016:0@lo:104: 00000100:00100000:3.0:1789061552.963528:0:11192:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789061552.963561:0:11192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a7af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a7a8 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061552.963562:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779509888 00010000:00010000:3.0:1789061552.963570:0:11192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a7af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a7a8 expref: 18 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061552.963579:0:11192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d196300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11192:1875966779510144:0@lo:104: 00000100:00100000:1.0:1789061552.963581:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779509888 00000100:00100000:3.0:1789061552.963599:0:11192:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789061552.963645:0:11192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a7a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f7b expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061552.963648:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779510016 00000100:00100000:1.0:1789061552.963651:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779510016 00010000:00010000:3.0:1789061552.963663:0:11192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a7a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f7b expref: 12 pid: 5844 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061552.963663:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779510144 00000100:00100000:1.0:1789061552.963666:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779510144 00000100:00100000:1.0:1789061552.963691:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789061552.963695:0:11192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11192:1875966779510272:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061552.963708:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+5:11192:x1875966779509888:12345-0@lo:104: 00010000:00010000:1.0:1789061552.963724:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a7cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061552.964094:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789061552.964106:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+5:11192:x1875966779510016:12345-0@lo:104: 00010000:00010000:2.0:1789061552.964115:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a7bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061552.965005:0:11192:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4ea02600 going to sleep for 11 seconds 00010000:00010000:2.0:1789061552.966341:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789061552.966358:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+5:11192:x1875966779510016:12345-0@lo:104: Request processed in 2251us (2824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061552.966372:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789061552.966434:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789061552.966458:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+4:11192:x1875966779510144:12345-0@lo:104: 00010000:00010000:2.0:1789061552.966478:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a7af expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.966576:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789061552.966581:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:24dfd7ac-7455-4043-9449-a564380782df+4:11192:x1875966779510144:12345-0@lo:104: Request processed in 139us (2981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061552.966587:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789061552.966611:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789061552.966619:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a7bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.966639:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525e00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1789061552.966644:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a7bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.966692:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a7bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061552.966701:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a7bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061552.966707:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789061552.967061:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a7bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.967070:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061552.967098:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a7bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.967107:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9a7b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a7bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.967123:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061552.967127:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a7af expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.967133:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1789061552.967136:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a7af expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.967144:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a7af expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061552.967150:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a7af expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061552.967164:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789061552.967182:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a7af expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.967188:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061552.967195:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a7af expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.967202:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a41476c00/0x427fa11dc4a9a7a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a7af expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.967214:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061552.967215:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061552.967217:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061552.967237:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779510400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061552.967290:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061552.967333:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061552.967339:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779510528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061552.967358:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061552.967439:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779510400 00000100:00100000:3.0:1789061552.968123:0:11192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d196d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11192:1875966779510016:0@lo:104: 00000100:00100000:3.0:1789061552.968137:0:11192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d196300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11192:1875966779510144:0@lo:104: 00000100:00100000:2.0:1789061552.968240:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779510400 00010000:00010000:2.0:1789061552.968282:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9a7bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a7b6 expref: 19 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061552.968317:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779510528 00000100:00100000:2.0:1789061552.968321:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779510528 00010000:00010000:2.0:1789061552.968333:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a7af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a7a8 expref: 20 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061552.968373:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789061552.968383:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+20:3312:x1875966779510400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789061552.968555:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061552.968563:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9a7bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a7b6 expref: 20 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.968575:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9a7bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a7b6 expref: 20 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.968594:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9a7bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a7b6 expref: 20 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.968610:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061552.968783:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789061552.968794:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779510528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789061552.968804:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061552.968809:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a7af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a7a8 expref: 19 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.968819:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a7af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a7a8 expref: 19 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.968829:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a7af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a7a8 expref: 19 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.968841:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061552.968970:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+18:3312:x1875966779510400:12345-0@lo:103:ldlm_bl.0 Request processed in 589us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061552.968979:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789061552.969922:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061552.970180:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+17:3312:x1875966779510528:12345-0@lo:103:ldlm_bl.0 Request processed in 1384us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061552.970192:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789061552.970299:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779510528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061552.970314:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779510400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061552.970916:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789061552.970926:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+3:11192:x1875966779509888:12345-0@lo:104: Request processed in 7218us (7519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061552.970941:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1789061552.971016:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061552.971027:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a7cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061552.971038:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061552.971044:0:8476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a7cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061552.971056:0:8476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a7cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061552.971064:0:8476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a7cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061552.971071:0:8476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789061552.971130:0:8476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a7cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061552.971138:0:8476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061552.971193:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a7cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061552.971202:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a7c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a7cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061552.971223:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061552.971226:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061552.971228:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061552.971238:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061552.971256:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779510656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789061552.971315:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061552.971423:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779510656 00000100:00100000:2.0:1789061552.971433:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779510656 00010000:00010000:2.0:1789061552.971477:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9a7cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a7c4 expref: 17 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061552.971542:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789061552.971552:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+17:3311:x1875966779510656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789061552.971566:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061552.971580:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9a7cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a7c4 expref: 17 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.971592:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9a7cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a7c4 expref: 17 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061552.971612:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061552.971846:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24dfd7ac-7455-4043-9449-a564380782df+17:3311:x1875966779510656:12345-0@lo:103:ldlm_bl.0 Request processed in 295us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061552.971854:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789061552.971892:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779510656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789061552.973027:0:11192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9a7cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a7c4 expref: 16 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061552.973049:0:11192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d195880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11192:1875966779509888:0@lo:104: 00000100:00100000:3.0:1789061552.973249:0:11192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d195c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11192:1875966779509760:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061552.973259:0:11192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11192:1875966779510272:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061552.973309:0:11192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061552.974900:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061552.974999:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758501376 00000100:00100000:1.0:1789061552.975010:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758501376 00010000:00010000:1.0:1789061552.975060:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7c525800/0x427fa11dc4a9a7e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fb3 expref: 13 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061552.975099:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:1.0:1789061552.975109:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758501376:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061552.975146:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061552.975153:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7c525800/0x427fa11dc4a9a7e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fb3 expref: 13 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.975167:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7c525800/0x427fa11dc4a9a7e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fb3 expref: 13 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.975190:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7c525800/0x427fa11dc4a9a7e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fb3 expref: 13 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.975210:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061552.975291:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46360ae1-9af4-4026-b4fe-276273cba6e7+12:2356:x1875966758501376:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 183us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061552.975299:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1789061552.977110:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061552.977190:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758501504 00000100:00100000:1.0:1789061552.977211:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758501504 00010000:00010000:1.0:1789061552.977252:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a7a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f7b expref: 12 pid: 5844 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061552.977294:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1789061552.977303:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46360ae1-9af4-4026-b4fe-276273cba6e7+12:2355:x1875966758501504:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061552.977319:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061552.977324:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a7a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f7b expref: 12 pid: 5844 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.977337:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a7a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f7b expref: 12 pid: 5844 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.977358:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41476600/0x427fa11dc4a9a7a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f7b expref: 12 pid: 5844 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.977392:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.977405:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.977427:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.977434:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.977442:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.977450:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.977456:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41477200 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061552.977461:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.977469:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.977562:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061552.977578:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061552.977822:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46360ae1-9af4-4026-b4fe-276273cba6e7+11:2355:x1875966758501504:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 353us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061552.977839:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00010000:00010000:3.0:1789061552.979235:0:11192:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.979253:0:11192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061552.979260:0:11192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a7fc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061553.022127:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061554.045752:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789061554.631034:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789061554.631041:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a75aff800 from 7 10000000:01000000:0.0:1789061554.631046:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789061554.631093:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.631105:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.631121:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061554.631150:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779510784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.631226:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061554.631276:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64ce6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061554.631302:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779510784 00000100:00100000:0.0:1789061554.631317:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779510784 00000100:00100000:0.0:1789061554.631370:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789061554.631380:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779510784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061554.631393:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061554.631406:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596d000/0x427fa11dc4a9a80a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a803 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.631429:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596d000/0x427fa11dc4a9a80a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a803 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.631439:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596d000/0x427fa11dc4a9a80a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a803 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.631447:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596d000, rc 0) 00000100:00100000:0.0:1789061554.631484:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779510784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061554.631509:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789061554.631554:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779510784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061554.631567:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a80a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.631575:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a80a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061554.631637:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779510912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.631673:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061554.631700:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64ce6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061554.631728:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779510912 00000100:00100000:0.0:1789061554.631738:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779510912 00000100:00100000:0.0:1789061554.631762:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789061554.631768:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779510912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.632016:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779510912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061554.632023:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789061554.632054:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779510912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.632079:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.632115:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061554.632128:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64ce6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061554.632140:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779511040 00000100:00100000:0.0:1789061554.632143:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779511040 00000100:00100000:0.0:1789061554.632163:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789061554.632170:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779511040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.632307:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779511040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061554.632313:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789061554.632350:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789061554.633015:0:11249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789061554.633067:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789061554.633088:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789061554.633096:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a80a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.633106:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a80a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061554.633130:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789061554.633133:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a7618e800 from 7 10000000:01000000:0.0:1789061554.633135:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789061554.633159:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.633167:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.633176:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061554.633192:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.633226:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061554.633250:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061554.633267:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779511168 00000100:00100000:0.0:1789061554.633272:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779511168 00000100:00100000:0.0:1789061554.633295:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789061554.633301:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779511168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061554.633311:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061554.633323:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596dc00/0x427fa11dc4a9a818 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a811 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.633341:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596dc00/0x427fa11dc4a9a818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a811 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.633351:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596dc00/0x427fa11dc4a9a818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a811 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.633369:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596dc00, rc 0) 00000100:00100000:0.0:1789061554.633402:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779511168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061554.633408:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789061554.633443:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061554.633454:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.633462:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061554.633527:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.633551:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061554.633568:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061554.633580:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779511296 00000100:00100000:0.0:1789061554.633584:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779511296 00000100:00100000:0.0:1789061554.633619:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789061554.633626:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779511296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.633811:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779511296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061554.633819:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789061554.646238:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061554.646308:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061554.646402:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061554.646609:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cbf70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061554.651305:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779511424 00000100:00100000:3.0:1789061554.651322:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779511424 00000100:00100000:3.0:1789061554.652681:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789061554.652694:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779511424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061554.653175:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779511424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 481us (6772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061554.653183:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789061554.653283:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789061554.653988:0:11250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789061554.654049:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789061554.654068:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789061554.654078:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061554.654089:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061554.654099:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789061554.654102:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a46ca8000 from 7 10000000:01000000:1.0:1789061554.654105:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789061554.654138:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061554.654147:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061554.654156:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061554.654175:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789061554.654232:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061554.664711:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cbf73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061554.669869:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779511552 00000100:00100000:0.0:1789061554.669885:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779511552 00000100:00100000:0.0:1789061554.669946:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789061554.669956:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779511552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061554.669987:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061554.670007:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9a826 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a81f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.670035:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9a826 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a81f expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.670046:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9a826 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a81f expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.670054:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596da00, rc 0) 00000100:00100000:0.0:1789061554.670142:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779511552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (15909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061554.670150:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789061554.670356:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061554.670378:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.670387:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061554.670463:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.670519:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061554.670550:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061554.670566:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779511680 00000100:00100000:0.0:1789061554.670570:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779511680 00000100:00100000:0.0:1789061554.670604:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789061554.670611:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779511680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.671226:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779511680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 605us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061554.671235:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789061554.673227:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061554.673314:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061554.673394:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061554.673441:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4ea026c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061554.679172:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779511808 00000100:00100000:0.0:1789061554.679189:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779511808 00000100:00100000:0.0:1789061554.679249:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789061554.679259:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779511808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.679538:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779511808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (6144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061554.679546:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789061554.681665:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779511808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789061554.685140:0:11251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789061554.685376:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789061554.685403:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789061554.685415:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.685428:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061554.790160:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061554.790255:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758501632 00000100:00100000:3.0:1789061554.790266:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758501632 00000100:00100000:3.0:1789061554.790331:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 244 00000100:00100000:3.0:1789061554.790342:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+11:5596:x1875966758501632:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061554.790359:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061554.790376:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a82d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca89fdd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061554.790406:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a82d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fdd expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061554.790416:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a82d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fdd expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061554.790426:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41477200, rc 0) 00000100:00100000:3.0:1789061554.790510:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+12:5596:x1875966758501632:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 170us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061554.790519:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 244 00000100:00100000:1.0:1789061554.801312:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061554.801427:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758501760 00000100:00100000:0.0:1789061554.801438:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758501760 00000100:00100000:0.0:1789061554.801526:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 245 00000100:00100000:0.0:1789061554.801536:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+12:5596:x1875966758501760:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.801837:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+12:5596:x1875966758501760:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 302us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061554.801845:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 245 00000100:00100000:1.0:1789061554.814066:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061554.814153:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758501888 00000100:00100000:0.0:1789061554.814164:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758501888 00000100:00100000:0.0:1789061554.814224:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 246 00000100:00100000:0.0:1789061554.814235:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+12:5596:x1875966758501888:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061554.814468:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+12:5596:x1875966758501888:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 235us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061554.814476:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 246 00000100:00100000:1.0:1789061554.823417:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061554.823521:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758502016 00000100:00100000:0.0:1789061554.823531:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758502016 00000100:00100000:0.0:1789061554.823599:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 247 00000100:00100000:0.0:1789061554.823611:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+12:5596:x1875966758502016:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061554.823627:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061554.823652:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596ce00/0x427fa11dc4a9a834 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca89fe4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.823681:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596ce00/0x427fa11dc4a9a834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fe4 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.823692:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596ce00/0x427fa11dc4a9a834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fe4 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061554.823699:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596ce00, rc 0) 00000100:00100000:0.0:1789061554.823760:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:5596:x1875966758502016:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 152us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061554.823767:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 247 00000100:00100000:2.0:1789061554.839015:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061554.847257:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758502144 00000100:00100000:1.0:1789061554.847274:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758502144 00000100:00100000:1.0:1789061554.847359:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 248 00000100:00100000:1.0:1789061554.847370:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:5596:x1875966758502144:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061554.847712:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:5596:x1875966758502144:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 343us (8706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061554.847720:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 248 00000100:00100000:2.0:1789061554.851604:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061554.851750:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758502272 00000100:00100000:3.0:1789061554.851761:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758502272 00000100:00100000:3.0:1789061554.851826:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 249 00000100:00100000:3.0:1789061554.851837:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:5596:x1875966758502272:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061554.852065:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:5596:x1875966758502272:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 229us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061554.852074:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 249 00000100:00100000:2.0:1789061554.942111:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779511936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061554.942198:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061554.942575:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779511936 00000100:00100000:1.0:1789061554.942597:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779511936 00000100:00100000:1.0:1789061554.942681:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789061554.942691:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779511936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061554.942727:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061554.942782:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779511936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061554.942789:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789061554.942842:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971945c90a80 x1875966779511936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061554.942861:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779511936:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789061554.943167:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789061555.071249:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061555.942121:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061555.942160:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061555.942180:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061555.942236:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758502528 00000100:00100000:1.0:1789061555.942245:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758502528 00000100:00100000:1.0:1789061555.942306:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758502656 00000100:00100000:1.0:1789061555.942310:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758502656 00000100:00100000:1.0:1789061555.942341:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:1.0:1789061555.942354:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758502528:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061555.942431:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758502528:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 80us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061555.942439:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:1.0:1789061555.942458:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:1.0:1789061555.942465:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758502656:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061555.942518:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758502656:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 54us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061555.942525:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00080000:1.0:1789061555.942543:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061555.942757:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758502400 00000100:00100000:0.0:1789061555.942769:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758502400 00000100:00100000:0.0:1789061555.942807:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 250 00000100:00100000:0.0:1789061555.942815:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758502400:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061555.942850:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758502400:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 37us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061555.942857:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 250 00010000:00010000:2.0:1789061556.095882:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061556.990826:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779512064:0@lo:400:kworker.0 00000100:00100000:3.0:1789061556.990828:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779512320:0@lo:400:kworker.0 00000100:00100000:3.0:1789061557.005733:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061557.005804:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061557.005816:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779512448:0@lo:400:kworker.0 00000100:00100000:3.0:1789061557.005859:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061557.005901:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779512320 00000100:00100000:3.0:1789061557.005908:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779512320 00000100:00100000:3.0:1789061557.006268:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789061557.006279:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779512320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061557.006337:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779512320:12345-0@lo:400:kworker.0 Request processed in 60us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061557.006344:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789061557.006370:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779512448 00000100:00100000:3.0:1789061557.006374:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779512448 00000100:00100000:3.0:1789061557.006407:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789061557.006414:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779512448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061557.006445:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779512448:12345-0@lo:400:kworker.0 Request processed in 32us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061557.006450:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789061557.006465:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789061557.006470:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061557.007746:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779512192:0@lo:400:kworker.0 00000100:00100000:2.0:1789061557.007807:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061557.008064:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779512704:0@lo:400:kworker.0 00000100:00100000:2.0:1789061557.008090:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061557.008134:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779512704 00000100:00100000:2.0:1789061557.008139:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779512704 00000100:00100000:2.0:1789061557.008180:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789061557.008186:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779512704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061557.008236:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779512704:12345-0@lo:400:kworker.0 Request processed in 50us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061557.008243:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1789061557.008280:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7d195880 x1875966779512704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061557.008296:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779512704:0@lo:400:kworker.0 00000100:00100000:2.0:1789061557.008330:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061557.008352:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779512064 00000100:00100000:2.0:1789061557.008356:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779512064 00000100:00100000:2.0:1789061557.008383:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789061557.008389:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779512064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061557.008418:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779512064:12345-0@lo:400:kworker.0 Request processed in 30us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061557.008424:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789061557.008459:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779512064:0@lo:400:kworker.0 00000100:00100000:2.0:1789061557.008468:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779512576:0@lo:400:kworker.0 00000100:00100000:2.0:1789061557.008506:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789061557.008567:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061557.008581:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779512192 00000100:00100000:2.0:1789061557.008584:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779512192 00000100:00100000:2.0:1789061557.008606:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779512576 00000100:00100000:2.0:1789061557.008608:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779512576 00000100:00100000:2.0:1789061557.008632:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789061557.008639:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779512192:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789061557.008667:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c2b6680 x1875966779512448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061557.008676:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779512192:12345-0@lo:400:kworker.0 Request processed in 36us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061557.008685:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779512448:0@lo:400:kworker.0 00000100:00100000:2.0:1789061557.008700:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789061557.008706:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779512320:0@lo:400:kworker.0 00000100:00100000:2.0:1789061557.008719:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789061557.008728:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779512576:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789061557.009679:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061557.011615:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779512576:12345-0@lo:400:kworker.0 Request processed in 2879us (3097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061557.011631:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789061557.011685:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779512576:0@lo:400:kworker.0 00000100:00100000:2.0:1789061557.011690:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779512192:0@lo:400:kworker.0 00010000:00010000:2.0:1789061557.129798:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789061557.445003:0:11391:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789061557.503890:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779512832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061557.503962:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061557.504040:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779512832 00000100:00100000:0.0:1789061557.504049:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779512832 00000100:00100000:0.0:1789061557.504096:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789061557.504106:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779512832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061557.504141:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061557.504187:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779512832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061557.504194:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789061557.504233:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75ef6680 x1875966779512832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061557.504253:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779512832:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789061558.145284:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061559.165768:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061560.065181:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779512960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061560.065299:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061560.066476:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779512960 00000100:00100000:2.0:1789061560.066525:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779512960 00000100:00080000:1.0:1789061560.066577:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061560.066620:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789061560.066634:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779512960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061560.066685:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061560.066760:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779512960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061560.066768:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789061560.067397:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9719477dd500 x1875966779512960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061560.067426:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779512960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789061560.193693:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061561.059481:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061561.059535:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061561.059555:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061561.059580:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758502912 00000100:00100000:3.0:1789061561.059599:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758502912 00000100:00100000:3.0:1789061561.059644:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758503040 00000100:00100000:3.0:1789061561.059647:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758503040 00000100:00100000:1.0:1789061561.059983:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:1.0:1789061561.059997:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758502912:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061561.060072:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758502912:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 79us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061561.060087:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:1.0:1789061561.060113:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758502784 00000100:00100000:1.0:1789061561.060116:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758502784 00000100:00100000:1.0:1789061561.060142:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 252 00000100:00100000:1.0:1789061561.060148:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758502784:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061561.060175:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758502784:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061561.060182:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 252 00000100:00080000:1.0:1789061561.060211:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061561.060217:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:3.0:1789061561.060226:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758503040:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061561.060258:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758503040:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061561.060265:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00010000:00010000:2.0:1789061561.215208:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789061561.661142:0:11490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 13:32:39 (1789061559) === 00000100:00100000:3.0:1789061561.799177:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061561.799691:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758503168 00000100:00100000:1.0:1789061561.799702:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758503168 00000100:00100000:1.0:1789061561.799756:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1789061561.799767:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758503168:12345-192.168.204.54@tcp:41:mkdir.0 00000004:00000024:1.0:1789061561.799814:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789061561.799903:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758503168:12345-192.168.204.54@tcp:41:mkdir.0 Request processed in 137us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061561.799912:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1789061561.800892:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061561.801446:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758503296 00000100:00100000:0.0:1789061561.801468:0:5860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758503296 00000100:00100000:0.0:1789061561.801558:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1789061561.801572:0:5860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:9697:x1875966758503296:12345-192.168.204.54@tcp:700:mkdir.0 00000100:00100000:0.0:1789061561.801658:0:5860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:9697:x1875966758503296:12345-192.168.204.54@tcp:700:mkdir.0 Request processed in 91us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061561.801669:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1789061561.804893:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061561.805023:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758503552 00000100:00100000:0.0:1789061561.805034:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758503552 00000100:00100000:0.0:1789061561.805091:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789061561.805101:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:9697:x1875966758503552:12345-192.168.204.54@tcp:36:mkdir.0 00010000:00010000:0.0:1789061561.805164:0:8391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061561.805244:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a71c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f66 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.806397:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636300) 00010000:00010000:0.0:1789061561.806412:0:8391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061561.806834:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a83b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.806851:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a83b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.806863:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a83b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.806901:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a842 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.806909:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a842 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.806915:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a842 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061561.812084:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789061561.812108:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a83b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.812120:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a83b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.812128:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a83b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.812136:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061561.812141:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a83b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.812150:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a83b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.812171:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:0.0:1789061561.812174:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061561.812178:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a83b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.812184:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a83b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061561.812208:0:8391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000210f19e9 reply state 00000000c44d252f transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a842 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061561.812218:0:8391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789061561.812642:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+7:9697:x1875966758503552:12345-192.168.204.54@tcp:36:mkdir.0 Request processed in 7537us (7753us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789061561.812662:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1789061561.820209:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061561.820550:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758503680 00000100:00100000:1.0:1789061561.820560:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758503680 00000100:00100000:1.0:1789061561.820629:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1789061561.820641:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+7:9698:x1875966758503680:12345-192.168.204.54@tcp:101:chmod.0 00010000:00010000:1.0:1789061561.820665:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061561.820693:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9a849 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca89feb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061561.820759:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9a850 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061561.820798:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9a850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061561.820810:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9a850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061561.820844:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789061561.820847:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789061561.820882:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9a850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061561.820906:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9a849 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89feb expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061561.820927:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9a850 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89feb expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061561.820936:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a6af68c00) 00010000:00010000:1.0:1789061561.820939:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789061561.820943:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525400, rc 0) 00000100:00100000:1.0:1789061561.821005:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+8:9698:x1875966758503680:12345-192.168.204.54@tcp:101:chmod.0 Request processed in 368us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061561.821012:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00010000:00010000:2.0:1789061561.821939:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a842 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061561.821952:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a842 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061561.821959:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a842 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061561.821965:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596de00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061561.821979:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a842 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061561.821987:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a842 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061561.822002:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff971a610eea00) 00010000:00010000:2.0:1789061561.822005:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061561.822010:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a842 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061561.822016:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a842 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061561.823663:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061561.823752:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758503936 00000100:00100000:3.0:1789061561.823763:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758503936 00000100:00100000:3.0:1789061561.823829:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1789061561.823840:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:9698:x1875966758503936:12345-192.168.204.54@tcp:36:chmod.0 00010000:00010000:3.0:1789061561.823892:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061561.823919:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9a850 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89feb expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.823935:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a6af68c00) 00010000:00010000:3.0:1789061561.823945:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061561.823969:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a857 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.823996:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a857 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.824006:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a857 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061561.824420:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b714997 reply state 00000000d0d1fc13 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a857 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061561.824430:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789061561.824437:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789061561.824610:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+8:9698:x1875966758503936:12345-192.168.204.54@tcp:36:chmod.0 Request processed in 770us (953us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789061561.824617:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00010000:00010000:3.0:1789061561.833844:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a857 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.833863:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a857 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.833871:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a857 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.833877:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41477800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061561.833881:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a857 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.833888:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a857 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.833908:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636100) 00010000:00010000:3.0:1789061561.833927:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789061561.833934:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a857 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.833939:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a857 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061561.877389:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061561.877681:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758504064 00000100:00100000:1.0:1789061561.877691:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758504064 00000100:00100000:0.0:1789061561.877931:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1789061561.877943:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+7:9699:x1875966758504064:12345-192.168.204.54@tcp:101:chown.0 00010000:00010000:0.0:1789061561.877970:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061561.877994:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a85e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca89ff2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.878062:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9a865 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.878078:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9a865 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.878089:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9a865 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061561.878125:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789061561.878128:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061561.878168:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9a865 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.878193:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a85e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89ff2 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.878216:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9a865 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89ff2 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.878372:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:0.0:1789061561.878376:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061561.878380:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596d200, rc 0) 00000100:00100000:0.0:1789061561.878443:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+8:9699:x1875966758504064:12345-192.168.204.54@tcp:101:chown.0 Request processed in 503us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061561.878450:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1789061561.881432:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061561.881540:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758504192 00000100:00100000:3.0:1789061561.881550:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758504192 00000100:00100000:3.0:1789061561.881612:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1789061561.881622:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+8:9699:x1875966758504192:12345-192.168.204.54@tcp:101:chown.0 00010000:00010000:3.0:1789061561.881641:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061561.881662:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a86c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca89ff9 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.881725:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476a00/0x427fa11dc4a9a873 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.881740:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476a00/0x427fa11dc4a9a873 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.881751:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476a00/0x427fa11dc4a9a873 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.881765:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a87a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.881782:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a87a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.881788:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a87a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.881891:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a881 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.881899:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.881906:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061561.881935:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789061561.881939:0:8391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789061561.881960:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.881972:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476a00/0x427fa11dc4a9a873 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.881978:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476a00/0x427fa11dc4a9a873 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.881984:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476a00/0x427fa11dc4a9a873 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.881989:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476a00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061561.881993:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476a00/0x427fa11dc4a9a873 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.882000:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476a00/0x427fa11dc4a9a873 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.882011:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:3.0:1789061561.882020:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061561.882025:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476a00/0x427fa11dc4a9a873 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.882031:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476a00/0x427fa11dc4a9a873 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.882045:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a87a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.882050:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a87a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.882055:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a87a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.882059:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061561.882062:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a87a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.882067:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a87a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.882073:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff971a43636100) 00010000:00010000:3.0:1789061561.882075:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061561.882078:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a87a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.882083:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9a87a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.882116:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a86c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89ff9 expref: 10 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.882144:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89ff9 expref: 9 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.882150:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff971a43636400) 00010000:00010000:3.0:1789061561.882152:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789061561.882155:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476600, rc 0) 00000100:00100000:3.0:1789061561.882211:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+9:9699:x1875966758504192:12345-192.168.204.54@tcp:101:chown.0 Request processed in 591us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061561.882218:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1789061561.887872:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061561.887995:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758504448 00000100:00100000:3.0:1789061561.888007:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758504448 00000100:00100000:3.0:1789061561.888067:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1789061561.888078:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+9:9699:x1875966758504448:12345-192.168.204.54@tcp:36:chown.0 00010000:00010000:3.0:1789061561.888132:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061561.888162:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89ff9 expref: 9 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.888181:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff971a43636400) 00010000:00010000:3.0:1789061561.888193:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061561.888218:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9a888 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.888232:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9a888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061561.888242:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9a888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061561.958366:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1789061561.958385:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1789061561.958673:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000feddb1cb reply state 0000000006c7d2a5 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9a888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061561.958689:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789061561.958705:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1789061561.958809:0:5853:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789061561.958871:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:9699:x1875966758504448:12345-192.168.204.54@tcp:36:chown.0 Request processed in 70790us (71006us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789061561.958880:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00010000:00010000:2.0:1789061561.959346:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9a888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061561.959357:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9a888 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061561.959365:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9a888 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061561.959371:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476c00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061561.959377:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9a888 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061561.959384:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9a888 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061561.959401:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff971a43636a00) 00010000:00010000:2.0:1789061561.959405:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789061561.959425:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9a888 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061561.959432:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9a888 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061561.978252:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061561.978381:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758504576 00000100:00100000:3.0:1789061561.978396:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758504576 00000100:00100000:3.0:1789061561.978484:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1789061561.978637:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:9700:x1875966758504576:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:3.0:1789061561.978673:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061561.978699:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a88f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a000 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789061561.982806:0:8391:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3739us 00010000:00010000:0.0:1789061561.994968:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a896 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995002:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995018:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995049:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a89d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995057:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a89d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995064:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a89d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995558:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9a8a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995573:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9a8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995580:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9a8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061561.995606:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789061561.995610:0:8391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061561.995654:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9a8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995668:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995675:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a896 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995683:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a896 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995689:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061561.995694:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a896 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995702:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a896 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995715:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:0.0:1789061561.995718:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061561.995724:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a896 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995740:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a896 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995754:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a89d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995759:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a89d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995765:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a89d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995779:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061561.995783:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a89d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995789:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a89d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995795:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff971a610eed00) 00010000:00010000:0.0:1789061561.995797:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061561.995799:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a89d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995805:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a89d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995854:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a88f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a000 expref: 8 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995870:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9a8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a000 expref: 7 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061561.995883:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff971a610ee700) 00010000:00010000:0.0:1789061561.995885:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789061561.995888:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596cc00, rc 0) 00000100:00100000:0.0:1789061561.995977:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+7:9700:x1875966758504576:12345-192.168.204.54@tcp:101:touch.500 Request processed in 17345us (17796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061561.995987:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:1.0:1789061562.006755:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061562.010763:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758504832 00000100:00100000:0.0:1789061562.010787:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758504832 00000100:00100000:0.0:1789061562.010907:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1789061562.010921:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+7:9700:x1875966758504832:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:0.0:1789061562.010950:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061562.010980:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9a8ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a007 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.011392:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a8b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.011415:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a8b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.011429:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a8b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.011446:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a8b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.012358:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.012392:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789061562.014210:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789061562.014702:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a8c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.014721:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.015628:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.015701:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a8b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.015709:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a8b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.015717:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a8b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.015723:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596de00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061562.015727:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a8b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.015848:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a8b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.015867:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff971a610ee700) 00010000:00010000:0.0:1789061562.015870:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061562.015890:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a8b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.015898:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a8b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061562.015917:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb6eed83 reply state 00000000fc26f260 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061562.015927:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789061562.015979:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9a8ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a007 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.015996:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a8c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a007 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.016004:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff971a610ee100) 00010000:00010000:0.0:1789061562.016006:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061562.016009:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596d800, rc 0) 00000100:00100000:0.0:1789061562.016860:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+10:9700:x1875966758504832:12345-192.168.204.54@tcp:101:touch.500 Request processed in 5936us (10123us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789061562.016871:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1789061562.027524:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061562.029213:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758505088 00000100:00100000:1.0:1789061562.029265:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758505088 00000100:00100000:1.0:1789061562.029358:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1789061562.029371:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+10:9700:x1875966758505088:12345-192.168.204.54@tcp:36:touch.500 00010000:00010000:1.0:1789061562.029477:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061562.029558:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a8c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a007 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.029584:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff971a610ee100) 00010000:00010000:1.0:1789061562.029602:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061562.029665:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9a8ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.029680:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9a8ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.029692:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9a8ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789061562.030024:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5029ae1 reply state 00000000692dc89f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9a8ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061562.030036:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789061562.030181:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+11:9700:x1875966758505088:12345-192.168.204.54@tcp:36:touch.500 Request processed in 812us (2697us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789061562.030190:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00010000:00010000:3.0:1789061562.034979:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.035006:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a8b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.035015:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.035023:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061562.035030:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.035064:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a8b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.035085:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff971a610ee500) 00010000:00010000:3.0:1789061562.035088:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061562.035094:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a8b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.035101:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a8b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061562.035658:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:3.0:1789061562.036016:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9a8ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.036029:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9a8ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.036036:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9a8ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.036041:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525c00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061562.036046:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9a8ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.036053:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9a8ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.036066:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff971a6af68800) 00010000:00010000:3.0:1789061562.036070:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061562.036074:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9a8ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.036094:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9a8ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061562.036558:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758505216 00000100:00100000:0.0:1789061562.036572:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758505216 00000100:00100000:0.0:1789061562.036636:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1789061562.036647:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+9:9700:x1875966758505216:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:0.0:1789061562.036678:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061562.036699:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9a8d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a00e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.036917:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9a8d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a00e expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.036935:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9a8d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a00e expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.036956:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff971a610eed00) 00010000:00010000:0.0:1789061562.036959:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789061562.036962:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c400, rc 0) 00000100:00100000:0.0:1789061562.037040:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+10:9700:x1875966758505216:12345-192.168.204.54@tcp:101:touch.500 Request processed in 394us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061562.037048:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:2.0:1789061562.040830:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061562.041006:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758505344 00000100:00100000:3.0:1789061562.041030:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758505344 00000100:00100000:3.0:1789061562.041097:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1789061562.041107:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875966758505344:12345-192.168.204.54@tcp:8:touch.500 00010000:00080000:3.0:1789061562.041152:0:8285:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:3.0:1789061562.041203:0:8285:0:(genops.c:1384:class_connect()) connect: client 778edf7b-5a2f-4729-afd3-c88291fdad66, cookie 0x427fa11dc4a9a8dc 00002000:00100000:3.0:1789061562.041219:0:8285:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 778edf7b-5a2f-4729-afd3-c88291fdad66/ffff971a75a6b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789061562.041251:0:8285:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789061562.041609:0:8285:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789061562.041654:0:8285:0:(import.c:65:import_set_state_nolock()) ffff971a75a6c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061562.041774:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2352:x1875966758505344:12345-192.168.204.54@tcp:8:touch.500 Request processed in 660us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061562.041783:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1789061562.048032:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061562.048241:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758505472 00000100:00100000:2.0:1789061562.048257:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758505472 00000100:00100000:2.0:1789061562.048355:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1789061562.048368:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:0:x1875966758505472:12345-192.168.204.54@tcp:2:touch.500 00000100:00080000:1.0:1789061562.049034:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061562.118203:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779513216:0@lo:400:kworker.0 00000100:00100000:3.0:1789061562.118300:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061562.118374:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779513728:0@lo:400:kworker.0 00000100:00100000:3.0:1789061562.118408:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061562.118445:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789061562.118464:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779513088:0@lo:400:kworker.0 00000100:00100000:3.0:1789061562.118692:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061562.119399:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779513600:0@lo:400:kworker.0 00000100:00100000:3.0:1789061562.119900:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061562.119959:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779513344:0@lo:400:kworker.0 00000100:00100000:1.0:1789061562.119960:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779513216 00000100:00100000:1.0:1789061562.119973:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779513216 00000100:00100000:3.0:1789061562.119997:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061562.120076:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779513600 00000100:00100000:1.0:1789061562.120081:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779513600 00000100:00100000:1.0:1789061562.120114:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779513344 00000100:00100000:1.0:1789061562.120118:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779513344 00000100:00100000:1.0:1789061562.120144:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789061562.120154:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779513216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061562.120356:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779513216:12345-0@lo:400:kworker.0 Request processed in 203us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061562.120378:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789061562.120397:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061562.120408:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789061562.120411:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779513472:0@lo:400:kworker.0 00000100:00100000:1.0:1789061562.120419:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779513600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061562.120461:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061562.120515:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779513600:12345-0@lo:400:kworker.0 Request processed in 64us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061562.120522:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789061562.120542:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789061562.120549:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779513344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061562.120588:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779513344:12345-0@lo:400:kworker.0 Request processed in 40us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061562.120595:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1789061562.120623:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061562.120720:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779513344:0@lo:400:kworker.0 00000100:00100000:3.0:1789061562.120763:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779513728 00000100:00100000:3.0:1789061562.120767:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779513728 00000100:00100000:3.0:1789061562.120980:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779513472 00000100:00100000:3.0:1789061562.120985:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779513472 00000100:00080000:1.0:1789061562.121004:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061562.121009:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061562.121063:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789061562.121072:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779513728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061562.121117:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779513728:12345-0@lo:400:kworker.0 Request processed in 47us (2708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061562.121124:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789061562.121204:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789061562.121211:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779513472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061562.121262:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779513472:12345-0@lo:400:kworker.0 Request processed in 51us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061562.121268:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789061562.121290:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779513088 00000100:00100000:3.0:1789061562.121294:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779513088 00000100:00100000:3.0:1789061562.121324:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789061562.121332:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779513088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061562.121366:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779513088:12345-0@lo:400:kworker.0 Request processed in 35us (2675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061562.121422:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789061562.121512:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779513088:0@lo:400:kworker.0 00000100:00100000:3.0:1789061562.121527:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779513600:0@lo:400:kworker.0 00000100:00100000:3.0:1789061562.121540:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779513216:0@lo:400:kworker.0 00010000:00080000:3.0:1789061562.121554:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75b14e00 x1875966779513728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061562.121566:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779513728:0@lo:400:kworker.0 00010000:00080000:0.0:1789061562.123594:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75b15f80 x1875966779513472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061562.123618:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779513472:0@lo:400:kworker.0 00000001:00080000:2.0:1789061562.144363:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1789061562.144388:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 778edf7b-5a2f-4729-afd3-c88291fdad66 00000100:00100000:1.0:1789061562.144553:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+5:0:x1875966758505472:12345-192.168.204.54@tcp:2:touch.500 Request processed in 96179us (96532us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789061562.144567:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:1.0:1789061562.148728:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061562.148854:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758505728 00000100:00100000:0.0:1789061562.148867:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758505728 00000100:00100000:0.0:1789061562.148949:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1789061562.148962:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+10:9700:x1875966758505728:12345-192.168.204.54@tcp:35:touch.500 00000100:00100000:0.0:1789061562.149468:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+11:9700:x1875966758505728:12345-192.168.204.54@tcp:35:touch.500 Request processed in 493us (739us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789061562.149478:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1789061562.187879:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061562.188041:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758505856 00000100:00100000:1.0:1789061562.188071:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758505856 00000100:00100000:1.0:1789061562.188149:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:1.0:1789061562.188162:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+11:9701:x1875966758505856:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:1.0:1789061562.188197:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061562.188224:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a8e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a015 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.188315:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9a8ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.188333:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9a8ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.188346:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9a8ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061562.188391:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789061562.188395:0:8391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789061562.188441:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9a8ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.188485:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a8e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a015 expref: 13 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.188575:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9a8ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a015 expref: 12 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.188584:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff971a610ee700) 00010000:00010000:1.0:1789061562.188588:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789061562.188592:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524600, rc 0) 00000100:00100000:1.0:1789061562.188688:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+12:9701:x1875966758505856:12345-192.168.204.54@tcp:101:rm.0 Request processed in 529us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061562.188697:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:1.0:1789061562.202690:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061562.202935:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758506112 00000100:00100000:3.0:1789061562.202953:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758506112 00000100:00100000:3.0:1789061562.203049:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:3.0:1789061562.203060:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+12:9701:x1875966758506112:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:3.0:1789061562.203092:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061562.203120:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a8f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a01c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061562.203252:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789061562.203879:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a8f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a01c expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.203900:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:3.0:1789061562.203904:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789061562.203911:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9a8f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a01c expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061562.203948:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41477800, rc 0) 00000100:00100000:3.0:1789061562.204090:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+13:9701:x1875966758506112:12345-192.168.204.54@tcp:101:rm.0 Request processed in 1031us (1599us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789061562.204099:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:2.0:1789061562.234929:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061562.235101:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758506240 00000100:00100000:0.0:1789061562.235116:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758506240 00000100:00100000:0.0:1789061562.235217:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:0.0:1789061562.235228:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+13:9701:x1875966758506240:12345-192.168.204.54@tcp:37:rm.0 00010000:00010000:3.0:1789061562.238933:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061562.241040:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+13:9701:x1875966758506240:12345-192.168.204.54@tcp:37:rm.0 Request processed in 5797us (6111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061562.241058:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:2.0:1789061562.247131:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061562.247326:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758506496 00000100:00100000:1.0:1789061562.247340:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758506496 00000100:00100000:1.0:1789061562.247456:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1789061562.247470:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a65026050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+13:9701:x1875966758506496:12345-192.168.204.54@tcp:35:rm.0 00000100:00100000:1.0:1789061562.247885:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a65026050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+14:9701:x1875966758506496:12345-192.168.204.54@tcp:35:rm.0 Request processed in 415us (764us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789061562.247894:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:2.0:1789061562.251136:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061562.251807:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758506752 00000100:00100000:0.0:1789061562.251824:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758506752 00000100:00100000:0.0:1789061562.251904:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1789061562.251917:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+14:9701:x1875966758506752:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:0.0:1789061562.251951:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061562.251981:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a8ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a023 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.252220:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a906 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.252239:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.252254:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061562.252267:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789061562.252445:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a8ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a023 expref: 17 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.252479:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a906 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a023 expref: 16 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.252713:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff971a610ee700) 00010000:00010000:0.0:1789061562.252716:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789061562.252721:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c600, rc 0) 00000100:00100000:0.0:1789061562.252997:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+16:9701:x1875966758506752:12345-192.168.204.54@tcp:101:rm.0 Request processed in 1081us (1886us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789061562.253006:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1789061562.256820:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061562.256900:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758506880 00000100:00100000:0.0:1789061562.256913:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758506880 00000100:00100000:0.0:1789061562.256979:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1789061562.256991:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+16:9701:x1875966758506880:12345-192.168.204.54@tcp:41:rm.0 00000004:00000024:0.0:1789061562.257072:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789061562.257164:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+16:9701:x1875966758506880:12345-192.168.204.54@tcp:41:rm.0 Request processed in 175us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061562.257172:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1789061562.260637:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061562.260749:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758507008 00000100:00100000:1.0:1789061562.260762:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758507008 00000100:00100000:1.0:1789061562.260835:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1789061562.260848:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+16:9701:x1875966758507008:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:1.0:1789061562.260873:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061562.260901:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a914 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a02a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.260991:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a91b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261009:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a91b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261039:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a91b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261059:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a922 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261088:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261096:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261233:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9a929 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261242:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9a929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261250:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9a929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061562.261284:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789061562.261290:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789061562.261315:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9a929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261329:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9a929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261338:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a91b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261347:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a91b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261354:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a91b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261372:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061562.261377:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a91b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261386:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a91b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261401:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff971a610ee700) 00010000:00010000:1.0:1789061562.261404:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061562.261410:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a91b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261417:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a91b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261433:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261439:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a922 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261456:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261461:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061562.261464:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261470:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a922 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261557:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff971a6af68100) 00010000:00010000:1.0:1789061562.261560:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061562.261563:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a922 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261570:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a922 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261609:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a914 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a02a expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261625:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9a929 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a02a expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.261633:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff971a610eed00) 00010000:00010000:1.0:1789061562.261635:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061562.261638:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524200, rc 0) 00000100:00100000:1.0:1789061562.261728:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+17:9701:x1875966758507008:12345-192.168.204.54@tcp:101:rm.0 Request processed in 882us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061562.261736:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:2.0:1789061562.265373:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061562.265532:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758507264 00000100:00100000:0.0:1789061562.265546:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758507264 00000100:00100000:0.0:1789061562.265618:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:0.0:1789061562.265631:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+17:9701:x1875966758507264:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:0.0:1789061562.265711:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789061562.265745:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9a929 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a02a expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.265782:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9a8d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a00e expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.265817:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff971a610eed00) 00010000:00010000:0.0:1789061562.265839:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9a8ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a015 expref: 15 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.265848:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff971a610ee700) 00010000:00010000:0.0:1789061562.265852:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061562.265878:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a930 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.265895:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a930 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.265905:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a930 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.265922:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a937 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.265929:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a937 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.265935:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a937 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.266127:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a93e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.266136:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a93e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.266154:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a93e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789061562.267072:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789061562.267086:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336508597696ns, next at 337508594338ns, rc = 0 00010000:00010000:0.0:1789061562.267170:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a945 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267183:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a945 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267194:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a945 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267203:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a945 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267211:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a945 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267217:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a945 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267235:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789061562.267258:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a93e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267265:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a93e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267272:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a93e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267285:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061562.267291:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a93e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267301:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a93e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267312:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff971a610ee500) 00010000:00010000:0.0:1789061562.267315:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789061562.267320:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a93e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267326:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9a93e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267345:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a930 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267351:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a930 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267357:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a930 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267361:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596de00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061562.267364:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a930 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267370:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a930 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267390:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff971a610ee700) 00010000:00010000:0.0:1789061562.267392:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061562.267396:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a930 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.267403:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9a930 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061562.267414:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e877121 reply state 00000000287c009e transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a937 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061562.267426:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789061562.268033:0:8477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061562.268043:0:8477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a945 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061562.268052:0:8477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c000 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061562.268055:0:8477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a945 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061562.268063:0:8477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a945 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061562.268092:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff971a610ee500) 00010000:00010000:2.0:1789061562.268094:0:8477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789061562.268098:0:8477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a945 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061562.268104:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9a945 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061562.268131:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061562.268133:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061562.268135:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061562.269620:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+16:9701:x1875966758507264:12345-192.168.204.54@tcp:36:rm.0 Request processed in 3979us (4248us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789061562.269636:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:3.0:1789061562.280548:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:0.0:1789061562.280690:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a937 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.280706:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a937 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.280715:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a937 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.280723:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061562.280729:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a937 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.280738:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a937 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.280784:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff971a610ee100) 00010000:00010000:0.0:1789061562.280787:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061562.280795:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a937 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.280802:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a937 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061562.280968:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758507520 00000100:00100000:2.0:1789061562.280982:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758507520 00000100:00100000:2.0:1789061562.281048:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1789061562.281061:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+15:9701:x1875966758507520:12345-192.168.204.54@tcp:35:rm.0 00000100:00100000:2.0:1789061562.281420:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+16:9701:x1875966758507520:12345-192.168.204.54@tcp:35:rm.0 Request processed in 360us (887us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789061562.281428:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1789061562.284385:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061562.284474:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758507776 00000100:00100000:1.0:1789061562.284538:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758507776 00000100:00100000:1.0:1789061562.284609:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:1.0:1789061562.284622:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+16:9701:x1875966758507776:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:1.0:1789061562.284712:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789061562.284748:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9a906 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a023 expref: 16 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.284809:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9a8a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a000 expref: 15 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.284821:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff971a610ee700) 00010000:00010000:1.0:1789061562.284840:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9a865 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89ff2 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.284849:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:1.0:1789061562.284856:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061562.284889:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a94c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.284904:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a94c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.284916:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a94c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.284930:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a953 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.284937:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a953 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.284944:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a953 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.285253:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a95a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.285273:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a95a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.285280:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a95a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061562.285979:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789061562.286000:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a95a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.286009:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a95a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.286016:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a95a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.286023:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061562.286028:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a95a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.286037:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a95a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.286048:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff971a6af68500) 00010000:00010000:1.0:1789061562.286051:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789061562.286056:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a95a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.286062:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9a95a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.286085:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a94c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.286099:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a94c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.286105:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a94c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.286110:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061562.286113:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a94c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.286120:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a94c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.286128:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a6af68100) 00010000:00010000:1.0:1789061562.286131:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061562.286134:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a94c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061562.286139:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9a94c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789061562.286152:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c3b5a08 reply state 0000000033412b69 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a953 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061562.286162:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789061562.286269:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+15:9701:x1875966758507776:12345-192.168.204.54@tcp:36:rm.0 Request processed in 1648us (1898us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789061562.286279:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00010000:00010000:0.0:1789061562.296404:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a953 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.296428:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a953 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.296436:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a953 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.296443:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061562.296459:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a953 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.296468:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a953 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.296536:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff971a6af68700) 00010000:00010000:0.0:1789061562.296540:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061562.296547:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a953 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061562.296554:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9a953 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061562.625008:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789061562.625054:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779513856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061562.625155:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061562.625833:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779513856 00000100:00100000:1.0:1789061562.625847:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779513856 00000100:00100000:1.0:1789061562.625946:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789061562.625958:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779513856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061562.625990:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061562.626126:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779513856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061562.626134:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789061562.626313:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9719477dd880 x1875966779513856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061562.626337:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779513856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789061563.264623:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061564.287145:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061565.182680:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061565.182702:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779513984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061565.182777:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061565.182834:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779513984 00000100:00100000:2.0:1789061565.182841:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779513984 00000100:00100000:2.0:1789061565.183013:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789061565.183023:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779513984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061565.183058:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061565.183108:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779513984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061565.183115:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789061565.183135:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061565.183162:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9719477dd880 x1875966779513984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061565.183179:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779513984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789061565.315460:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061566.204014:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061566.204109:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061566.215737:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061566.215794:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061566.215839:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758507904 00000100:00100000:0.0:1789061566.215851:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758507904 00000100:00100000:0.0:1789061566.215910:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 254 00000100:00100000:0.0:1789061566.215921:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2355:x1875966758507904:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061566.216025:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2355:x1875966758507904:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 105us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061566.216032:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 254 00000100:00100000:0.0:1789061566.216069:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758508160 00000100:00100000:0.0:1789061566.216072:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758508160 00000100:00100000:0.0:1789061566.216111:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:0.0:1789061566.216117:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758508160:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061566.216143:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758508160:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061566.216149:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00080000:0.0:1789061566.216286:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061566.226395:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758508032 00000100:00100000:3.0:1789061566.226416:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758508032 00000100:00100000:3.0:1789061566.226541:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758508288 00000100:00100000:3.0:1789061566.226545:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758508288 00000100:00100000:3.0:1789061566.226574:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:3.0:1789061566.226585:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+14:2355:x1875966758508032:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061566.226703:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+14:2355:x1875966758508032:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 118us (22703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061566.226711:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:3.0:1789061566.226733:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:3.0:1789061566.226756:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758508288:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061566.226926:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758508288:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 170us (22816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061566.226943:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00080000:0.0:1789061566.227425:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789061566.340722:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789061567.174883:0:11642:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1789061567.231898:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779514240:0@lo:400:kworker.0 00000100:00100000:0.0:1789061567.231968:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061567.232017:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779514752:0@lo:400:kworker.0 00000100:00100000:0.0:1789061567.232042:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061567.232082:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789061567.232091:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779514112:0@lo:400:kworker.0 00000100:00100000:0.0:1789061567.232116:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061567.232136:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779514624:0@lo:400:kworker.0 00000100:00100000:0.0:1789061567.232154:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061567.232177:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779514496:0@lo:400:kworker.0 00000100:00100000:0.0:1789061567.232199:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061567.232216:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061567.232221:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779514368:0@lo:400:kworker.0 00000100:00100000:0.0:1789061567.232239:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061567.232266:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779514240 00000100:00100000:0.0:1789061567.232274:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779514240 00000100:00100000:3.0:1789061567.233076:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779514624 00000100:00100000:3.0:1789061567.233083:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779514624 00000100:00100000:3.0:1789061567.233117:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779514368 00000100:00100000:3.0:1789061567.233120:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779514368 00000100:00100000:3.0:1789061567.233137:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789061567.233146:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779514240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061567.233209:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779514240:12345-0@lo:400:kworker.0 Request processed in 64us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061567.233216:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789061567.233233:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789061567.233239:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779514624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061567.233266:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779514624:12345-0@lo:400:kworker.0 Request processed in 28us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061567.233272:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789061567.233284:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789061567.233289:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779514368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061567.233446:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779514752 00000100:00100000:0.0:1789061567.233452:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779514752 00000100:00100000:0.0:1789061567.233482:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779514496 00000100:00100000:0.0:1789061567.233506:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779514496 00000100:00100000:0.0:1789061567.233531:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789061567.233538:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779514752:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789061567.236099:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061567.236109:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061567.236113:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061567.236146:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789061567.236183:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779514496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061567.236632:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779514752:12345-0@lo:400:kworker.0 Request processed in 3092us (4586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061567.236642:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789061567.236698:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779514624:0@lo:400:kworker.0 00000100:00100000:0.0:1789061567.236711:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779514240:0@lo:400:kworker.0 00010000:00080000:0.0:1789061567.236723:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7cd2f800 x1875966779514752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061567.236733:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779514752:0@lo:400:kworker.0 00000100:00100000:3.0:1789061567.236844:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779514368:12345-0@lo:400:kworker.0 Request processed in 3551us (4600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061567.236854:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789061567.238501:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779514496:12345-0@lo:400:kworker.0 Request processed in 2323us (6279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061567.238513:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789061567.238551:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779514112 00000100:00100000:2.0:1789061567.238560:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779514112 00000100:00100000:0.0:1789061567.244596:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779514368:0@lo:400:kworker.0 00010000:00080000:0.0:1789061567.244617:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7cd2dc00 x1875966779514496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061567.244628:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779514496:0@lo:400:kworker.0 00000100:00100000:2.0:1789061567.252874:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789061567.253810:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779514112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061567.253917:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779514112:12345-0@lo:400:kworker.0 Request processed in 1029us (21798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061567.253935:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789061567.263730:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779514112:0@lo:400:kworker.0 00000001:00080000:0.0:1789061567.330835:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1789061567.330850:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789061567.330883:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1789061567.331652:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061567.331671:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779514880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789061567.331984:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061567.333092:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779514880 00000100:00100000:1.0:1789061567.333104:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779514880 00000100:00100000:1.0:1789061567.333167:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789061567.333177:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779514880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789061567.333204:0:6702:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1789061567.333240:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa2e9b8, atime: 0x6aa2e9b8, ctime: 0x6aa2e9b8, blocks: 0x1 00010000:00010000:1.0:1789061567.333247:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9a961 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061567.333264:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1789061567.333268:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061567.333274:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9a961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061567.333291:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9a961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061567.333302:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9a961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061567.333329:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9a961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061567.333363:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789061567.333985:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875966779514880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 807us (2000us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789061567.333993:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789061567.334022:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061567.334029:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9a961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061567.334038:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524c00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061567.334043:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9a961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061567.334053:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9a961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061567.334072:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9a961 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061567.334079:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9a961 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061567.334097:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061567.334105:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061567.334107:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789061567.334143:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff971a7cd2dc00/2, rc 0, transno 4294967300 00000100:00100000:1.0:1789061567.334150:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779514880:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789061567.360910:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061567.750001:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779515008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061567.750073:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061567.750152:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779515008 00000100:00100000:0.0:1789061567.750161:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779515008 00000100:00100000:0.0:1789061567.750208:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789061567.750217:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875966779515008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061567.750258:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061567.750305:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875966779515008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061567.750311:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789061567.750373:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779515008:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789061568.383302:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789061568.875398:0:11692:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1e7c18c0 20000000:00000080:0.0:1789061568.875424:0:11692:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9719458b7000 uarg=0000000000000000 20000000:01000000:0.0:1789061568.875480:0:11692:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789061568.875529:0:11692:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789061568.875543:0:11692:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789061568.884410:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789061568.885028:0:11692:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789061568.902888:0:11692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789061568.902966:0:11692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1789061568.903052:0:11692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1789061568.903077:0:11692:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789061568.903108:0:11692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.903132:0:11692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7596d000/0x427fa11dc4a9a80a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a803 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.903159:0:11692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7596dc00/0x427fa11dc4a9a818 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a811 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.903168:0:11692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9a826 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a81f expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.903180:0:11692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a82d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fdd expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.903188:0:11692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7596ce00/0x427fa11dc4a9a834 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fe4 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.903197:0:11692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.903255:0:11692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7596ce00/0x427fa11dc4a9a834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fe4 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.903277:0:11692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a7596ce00/0x427fa11dc4a9a834 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fe4 expref: 12 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061568.903313:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11692:1875966779515136:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061568.903480:0:11692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a82d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fdd expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.903530:0:11692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a82d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fdd expref: 12 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061568.903539:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11692:1875966779515264:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061568.903588:0:11692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9a826 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a81f expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.903597:0:11692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9a826 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a81f expref: 18 pid: 5844 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061568.903607:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11692:1875966779515392:0@lo:104: 00000100:00100000:2.0:1789061568.903658:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789061568.903707:0:11692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7596dc00/0x427fa11dc4a9a818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a811 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.903715:0:11692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a7596dc00/0x427fa11dc4a9a818 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a811 expref: 18 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061568.903724:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11692:1875966779515520:0@lo:104: 00000100:00100000:2.0:1789061568.903747:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789061568.903776:0:11692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7596d000/0x427fa11dc4a9a80a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9a803 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.903785:0:11692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff971a7596d000/0x427fa11dc4a9a80a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9a803 expref: 18 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061568.903794:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11692:1875966779515648:0@lo:104: 00000100:00100000:2.0:1789061568.903825:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061568.903843:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4ea02900 going to sleep for 11 seconds 00000100:00100000:1.0:1789061568.904172:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789061568.904191:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779515392 00000100:00100000:1.0:1789061568.904202:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779515392 00000100:00100000:1.0:1789061568.904261:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779515520 00000100:00100000:1.0:1789061568.904265:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779515520 00000100:00100000:1.0:1789061568.904277:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779515648 00000100:00100000:1.0:1789061568.904280:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779515648 00000100:00100000:1.0:1789061568.904295:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789061568.904306:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+5:11692:x1875966779515392:12345-0@lo:104: 00010000:00010000:1.0:1789061568.904334:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.904422:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789061568.904429:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+5:11692:x1875966779515392:12345-0@lo:104: Request processed in 125us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061568.904437:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789061568.904458:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789061568.904465:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+4:11692:x1875966779515520:12345-0@lo:104: 00010000:00010000:1.0:1789061568.904474:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.904543:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789061568.904549:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+4:11692:x1875966779515520:12345-0@lo:104: Request processed in 85us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061568.904555:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789061568.904580:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789061568.904587:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971944fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+3:11692:x1875966779515648:12345-0@lo:104: 00010000:00010000:1.0:1789061568.904595:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a80a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.904633:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789061568.904698:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971944fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:24dfd7ac-7455-4043-9449-a564380782df+3:11692:x1875966779515648:12345-0@lo:104: Request processed in 111us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061568.904705:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789061568.904762:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789061568.904770:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.904778:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061568.904784:0:8476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.904796:0:8476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061568.904805:0:8476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061568.904812:0:8476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789061568.904853:0:8476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.904861:0:8476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061568.904888:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.904908:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a81f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.904925:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789061568.904929:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.904935:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d600 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061568.904939:0:8476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.904947:0:8476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061568.904954:0:8476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061568.904959:0:8476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789061568.904974:0:8476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.904980:0:8476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061568.904987:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.904994:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a7596d600/0x427fa11dc4a9a811 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.905003:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061568.905012:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9a80a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.905019:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596ca00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061568.905022:0:8476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9a80a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.905029:0:8476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9a80a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061568.905035:0:8476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9a80a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061568.905041:0:8476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789061568.905054:0:8476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a80a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.905061:0:8476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061568.905078:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a80a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.905085:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a7596ca00/0x427fa11dc4a9a803 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9a80a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.905104:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061568.905106:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061568.905109:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061568.905116:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061568.905131:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779515776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061568.905171:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061568.905213:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061568.905226:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779515904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061568.905251:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061568.905281:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779516032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061568.905306:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061568.905348:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779515776 00000100:00100000:1.0:1789061568.905355:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779515776 00010000:00010000:1.0:1789061568.905379:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9a826 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a81f expref: 19 pid: 5844 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061568.905405:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779515904 00000100:00100000:1.0:1789061568.905408:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779515904 00010000:00010000:1.0:1789061568.905420:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7596dc00/0x427fa11dc4a9a818 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a811 expref: 20 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061568.905431:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779516032 00000100:00100000:1.0:1789061568.905433:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779516032 00010000:00010000:1.0:1789061568.905444:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7596d000/0x427fa11dc4a9a80a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a803 expref: 21 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061568.905456:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789061568.905463:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24dfd7ac-7455-4043-9449-a564380782df+21:3312:x1875966779515776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061568.905476:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061568.905482:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9a826 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a81f expref: 21 pid: 5844 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.905523:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9a826 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a81f expref: 21 pid: 5844 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.905544:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061568.905579:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24dfd7ac-7455-4043-9449-a564380782df+21:3312:x1875966779515776:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061568.905593:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789061568.905610:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789061568.905616:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24dfd7ac-7455-4043-9449-a564380782df+20:3312:x1875966779515904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061568.905624:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061568.905628:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7596dc00/0x427fa11dc4a9a818 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a811 expref: 20 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061568.905932:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061568.905970:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789061568.905980:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+20:3310:x1875966779516032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789061568.905990:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061568.905997:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7596d000/0x427fa11dc4a9a80a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9a803 expref: 20 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.906133:0:11692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9a826 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a81f expref: 20 pid: 5844 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061568.906159:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11692:1875966779515392:0@lo:104: 00000100:00100000:2.0:1789061568.906173:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11692:1875966779515520:0@lo:104: 00000100:00100000:2.0:1789061568.906207:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11692:1875966779515648:0@lo:104: 00010000:00010000:1.0:1789061568.907857:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7596dc00/0x427fa11dc4a9a818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a811 expref: 19 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061568.909958:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7596d000/0x427fa11dc4a9a80a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9a803 expref: 19 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061568.909989:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7596d000/0x427fa11dc4a9a80a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a803 expref: 19 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061568.910005:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061568.910113:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+18:3310:x1875966779516032:12345-0@lo:103:ldlm_bl.0 Request processed in 4134us (4804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061568.910124:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789061568.910215:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779515776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061568.910410:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779516032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789061568.913052:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061568.913533:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11692:1875966779515136:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061568.913551:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11692:1875966779515264:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061568.913590:0:11692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061568.914568:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:1.0:1789061568.915682:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7596dc00/0x427fa11dc4a9a818 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9a811 expref: 17 pid: 5843 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061568.915713:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061568.915830:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24dfd7ac-7455-4043-9449-a564380782df+16:3312:x1875966779515904:12345-0@lo:103:ldlm_bl.0 Request processed in 10212us (10575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061568.915842:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789061568.915950:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779515904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061568.931513:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758508416 00000100:00100000:1.0:1789061568.931534:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758508416 00010000:00010000:1.0:1789061568.931590:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7596ce00/0x427fa11dc4a9a834 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fe4 expref: 13 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061568.935290:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758508544 00000100:00100000:3.0:1789061568.935315:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758508544 00010000:00010000:3.0:1789061568.936014:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a82d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fdd expref: 14 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061568.940003:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1789061568.940051:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46360ae1-9af4-4026-b4fe-276273cba6e7+14:2356:x1875966758508416:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061568.940113:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061568.940129:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7596ce00/0x427fa11dc4a9a834 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fe4 expref: 14 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.940165:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7596ce00/0x427fa11dc4a9a834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fe4 expref: 14 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.940191:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7596ce00/0x427fa11dc4a9a834 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fe4 expref: 14 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.940226:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061568.940611:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758508416:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 578us (27563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061568.940622:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1789061568.940821:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:2.0:1789061568.940832:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46360ae1-9af4-4026-b4fe-276273cba6e7+12:2356:x1875966758508544:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061568.940851:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061568.940857:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a82d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fdd expref: 12 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.940867:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a82d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fdd expref: 12 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.940878:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a82d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fdd expref: 12 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.940894:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.940903:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.940922:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.940930:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.940936:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.940944:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.940951:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fc00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061568.940956:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.940976:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061568.960827:0:11692:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061568.960855:0:11692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.961663:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.961681:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63fc00/0x427fa11dc4a9a968 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061568.961717:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061568.968893:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46360ae1-9af4-4026-b4fe-276273cba6e7+11:2356:x1875966758508544:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 28043us (54313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061568.968912:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00010000:00010000:3.0:1789061569.405877:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061570.302358:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779516160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061570.302451:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061570.302628:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779516160 00000100:00100000:1.0:1789061570.302638:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779516160 00000100:00100000:1.0:1789061570.302971:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789061570.303232:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779516160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061570.303274:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789061570.303428:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061570.303540:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779516160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 557us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061570.303557:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789061570.303664:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c2b4e00 x1875966779516160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061570.303684:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779516160:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1789061570.365953:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789061570.365961:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a75aff800 from 7 10000000:01000000:0.0:1789061570.365967:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789061570.366018:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061570.366031:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061570.366043:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061570.366068:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779516288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789061570.366381:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061570.366843:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061570.367163:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779516288 00000100:00100000:3.0:1789061570.367174:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779516288 00000100:00100000:3.0:1789061570.367446:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789061570.367458:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+16:5848:x1875966779516288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061570.367473:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061570.367505:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a976 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a96f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061570.367533:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a96f expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061570.367543:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a96f expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061570.367551:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41477800, rc 0) 00000100:00100000:3.0:1789061570.367641:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779516288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061570.367662:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789061570.367751:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779516288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061570.367767:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061570.367776:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061570.367846:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779516416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061570.367878:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061570.369156:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4523d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061570.369284:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779516416 00000100:00100000:0.0:1789061570.369303:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779516416 00000100:00100000:0.0:1789061570.369344:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789061570.369353:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779516416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061570.370098:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779516416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 743us (2215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061570.370108:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789061570.370311:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779516416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061570.370364:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779516544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061570.370411:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061570.370446:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4523d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061570.370754:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779516544 00000100:00100000:0.0:1789061570.370761:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779516544 00000100:00100000:0.0:1789061570.370795:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789061570.370802:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779516544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061570.370988:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779516544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061570.370996:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789061570.371230:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779516544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061570.371988:0:11705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:11705:1875966779516672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061570.372040:0:11705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061570.372228:0:11705:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4523d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789061570.372365:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779516672 00000100:00100000:0.0:1789061570.372372:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779516672 00000100:00100000:0.0:1789061570.372403:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789061570.372409:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:11705:x1875966779516672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061570.372848:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:11705:x1875966779516672:12345-0@lo:502:llog_process_th.0 Request processed in 438us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061570.372856:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789061570.373310:0:11705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:11705:1875966779516672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789061570.373349:0:11705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061570.373359:0:11705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061570.373362:0:11705:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789061570.373368:0:11705:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff971a75aff800 00000020:00000080:1.0:1789061570.373378:0:11705:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789061570.373469:0:11705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:11705:1875966779516800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061570.373536:0:11705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061570.373561:0:11705:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4523d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789061570.375558:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779516800 00000100:00100000:1.0:1789061570.375657:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779516800 00000100:00100000:1.0:1789061570.375708:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789061570.375717:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:11705:x1875966779516800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061570.375984:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:11705:x1875966779516800:12345-0@lo:502:llog_process_th.0 Request processed in 267us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061570.375991:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789061570.376057:0:11705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:11705:1875966779516800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789061570.376094:0:11705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061570.376102:0:11705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061570.376104:0:11705:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789061570.376109:0:11705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789061570.377652:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789061570.377676:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789061570.377687:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061570.377700:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061570.377711:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789061570.377713:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a7618e800 from 7 10000000:01000000:1.0:1789061570.377716:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789061570.377752:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061570.377772:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061570.377784:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061570.377809:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779516928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789061570.377870:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061570.377908:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4523d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789061570.377931:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779516928 00000100:00100000:1.0:1789061570.377937:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779516928 00000100:00100000:1.0:1789061570.377969:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789061570.377977:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+17:5848:x1875966779516928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061570.377988:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061570.378000:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9a984 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a97d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061570.378023:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9a984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a97d expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061570.378033:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9a984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a97d expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061570.378042:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524800, rc 0) 00000100:00100000:1.0:1789061570.378076:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779516928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061570.378082:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789061570.378132:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779516928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061570.378145:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061570.378155:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061570.378205:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779517056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061570.378228:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061570.378241:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4523d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789061570.378253:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779517056 00000100:00100000:1.0:1789061570.378256:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779517056 00000100:00100000:1.0:1789061570.378272:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789061570.378278:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779517056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061570.379961:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779517056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1676us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061570.379973:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789061570.380020:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779517056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061570.380066:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779517184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061570.380108:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061570.380131:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4523d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789061570.380741:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779517184 00000100:00100000:3.0:1789061570.380749:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779517184 00000100:00100000:3.0:1789061570.380793:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789061570.380801:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779517184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061570.380995:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779517184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061570.381004:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789061570.381053:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75aeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779517184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061570.381356:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:11707:1875966779517312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061570.381398:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061570.381420:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779517312 00000100:00100000:3.0:1789061570.381424:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779517312 00000100:00100000:3.0:1789061570.381442:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789061570.381449:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:11707:x1875966779517312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061570.381666:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:11707:x1875966779517312:12345-0@lo:502:llog_process_th.0 Request processed in 218us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061570.381673:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789061570.381714:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061570.381727:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:11707:1875966779517312:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789061570.381747:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061570.381756:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061570.381758:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789061570.381765:0:11707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff971a7618e800 00000020:00000080:3.0:1789061570.381767:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789061570.382018:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:11707:1875966779517440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061570.382056:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061570.382075:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779517440 00000100:00100000:3.0:1789061570.382079:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779517440 00000100:00100000:3.0:1789061570.382098:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789061570.382105:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:11707:x1875966779517440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061570.382224:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:11707:x1875966779517440:12345-0@lo:502:llog_process_th.0 Request processed in 118us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061570.382231:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789061570.382261:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061570.382273:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:11707:1875966779517440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789061570.382471:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061570.382477:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061570.382478:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789061570.382482:0:11707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789061570.382556:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789061570.382574:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789061570.382584:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061570.382596:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061570.382606:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789061570.382609:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a46ca8000 from 7 10000000:01000000:3.0:1789061570.382612:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789061570.382636:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061570.382655:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061570.382665:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061570.382680:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779517568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789061570.382711:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061570.382724:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a411ca000 going to sleep for 11 seconds 00000100:00100000:3.0:1789061570.382741:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779517568 00000100:00100000:3.0:1789061570.382746:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779517568 00000100:00100000:3.0:1789061570.382764:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789061570.382770:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+18:5848:x1875966779517568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061570.382780:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061570.382793:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a992 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9a98b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061570.382815:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9a98b expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061570.382825:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9a98b expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061570.382832:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476a00, rc 0) 00000100:00100000:3.0:1789061570.382860:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779517568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061570.382866:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789061570.382905:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779517568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061570.382917:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061570.382926:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061570.382966:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779517696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061570.382989:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061570.383002:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04000 going to sleep for 11 seconds 00000100:00100000:3.0:1789061570.383014:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779517696 00000100:00100000:3.0:1789061570.383017:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779517696 00000100:00100000:3.0:1789061570.383030:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789061570.383036:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779517696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061570.384960:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779517696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1917us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061570.384974:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789061570.385440:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779517696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061570.385529:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779517824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061570.386721:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061570.386770:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4ea02900 going to sleep for 11 seconds 00000100:00100000:0.0:1789061570.387519:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779517824 00000100:00100000:0.0:1789061570.387530:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779517824 00000100:00100000:0.0:1789061570.387817:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789061570.387829:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779517824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061570.388413:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:24dfd7ac-7455-4043-9449-a564380782df:5848:1875966779517824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061570.388784:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:5848:x1875966779517824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 955us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061570.388789:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:11709:1875966779517952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061570.388797:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789061570.388842:0:11709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061570.388880:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4ea02000 going to sleep for 11 seconds 00000100:00100000:1.0:1789061570.388925:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779517952 00000100:00100000:1.0:1789061570.388932:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779517952 00000100:00100000:1.0:1789061570.388974:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789061570.388985:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:11709:x1875966779517952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061570.389149:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:11709:x1875966779517952:12345-0@lo:502:llog_process_th.0 Request processed in 167us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061570.389163:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789061570.389235:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:11709:1875966779517952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061570.389256:0:11709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061570.389265:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061570.389267:0:11709:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789061570.389274:0:11709:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff971a46ca8000 00000020:00000080:2.0:1789061570.389277:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789061570.389370:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:11709:1875966779518080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061570.389411:0:11709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061570.389423:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4ea02000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061570.389993:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779518080 00000100:00100000:0.0:1789061570.390000:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779518080 00000100:00100000:0.0:1789061570.390290:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789061570.390311:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4e13e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:11709:x1875966779518080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061570.390567:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4e13e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:11709:x1875966779518080:12345-0@lo:502:llog_process_th.0 Request processed in 258us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061570.390576:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789061570.390660:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:24dfd7ac-7455-4043-9449-a564380782df:11709:1875966779518080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789061570.390685:0:11709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061570.390693:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061570.390695:0:11709:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789061570.390703:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789061570.390791:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789061570.390812:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789061570.390823:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061570.390836:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789061570.399961:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789061570.432311:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061570.789830:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061570.789972:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758508672 00000100:00100000:1.0:1789061570.789989:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758508672 00000100:00100000:1.0:1789061570.790066:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 271 00000100:00100000:1.0:1789061570.790077:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+11:5596:x1875966758508672:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061570.790096:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061570.790116:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c525400/0x427fa11dc4a9a999 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a031 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061570.790146:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c525400/0x427fa11dc4a9a999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a031 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061570.790160:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c525400/0x427fa11dc4a9a999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a031 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061570.790170:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525400, rc 0) 00000100:00100000:1.0:1789061570.790251:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+12:5596:x1875966758508672:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 175us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061570.790259:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 271 00000100:00100000:0.0:1789061570.795613:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061570.795745:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758508800 00000100:00100000:2.0:1789061570.795761:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758508800 00000100:00100000:2.0:1789061570.795851:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 272 00000100:00100000:2.0:1789061570.795863:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+12:5596:x1875966758508800:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061570.796185:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+12:5596:x1875966758508800:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 324us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061570.796193:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 272 00000100:00100000:0.0:1789061570.808343:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061570.808525:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758508928 00000100:00100000:3.0:1789061570.808546:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758508928 00000100:00100000:3.0:1789061570.808622:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 273 00000100:00100000:3.0:1789061570.808634:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+12:5596:x1875966758508928:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061570.808919:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+12:5596:x1875966758508928:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 286us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061570.808929:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 273 00000100:00100000:0.0:1789061570.819357:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061570.819725:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758509056 00000100:00100000:1.0:1789061570.819740:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758509056 00000100:00100000:1.0:1789061570.819810:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 274 00000100:00100000:1.0:1789061570.819820:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+12:9973:x1875966758509056:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789061570.820146:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+12:9973:x1875966758509056:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 325us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061570.820154:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 274 00000100:00100000:0.0:1789061570.825968:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061570.830171:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758509184 00000100:00100000:2.0:1789061570.830188:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758509184 00000100:00100000:2.0:1789061570.830349:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 275 00000100:00100000:2.0:1789061570.830363:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+12:9973:x1875966758509184:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789061570.833410:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+12:9973:x1875966758509184:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 3039us (7444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061570.833426:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 275 00000100:00100000:0.0:1789061570.869654:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061570.869858:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758509312 00000100:00100000:3.0:1789061570.869891:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758509312 00000100:00100000:3.0:1789061570.869968:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 276 00000100:00100000:3.0:1789061570.869981:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+12:5596:x1875966758509312:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061570.870005:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061570.870031:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a9a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a038 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061570.870070:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a9a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a038 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061570.870083:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a9a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a038 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061570.870094:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41477200, rc 0) 00000100:00100000:3.0:1789061570.870174:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:5596:x1875966758509312:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 195us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061570.870182:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 276 00000100:00100000:0.0:1789061570.880306:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061570.882594:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758509440 00000100:00100000:2.0:1789061570.882623:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758509440 00000100:00100000:2.0:1789061570.882711:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 277 00000100:00100000:2.0:1789061570.882724:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:5596:x1875966758509440:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061570.883127:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:5596:x1875966758509440:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 404us (2846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061570.883136:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 277 00000100:00100000:0.0:1789061570.885824:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061570.885935:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758509568 00000100:00100000:1.0:1789061570.885949:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758509568 00000100:00100000:1.0:1789061570.886015:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 278 00000100:00100000:1.0:1789061570.886026:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:5596:x1875966758509568:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061570.886397:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:5596:x1875966758509568:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 371us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061570.886406:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 278 00000100:00100000:0.0:1789061570.899164:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061570.899276:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758509696 00000100:00100000:3.0:1789061570.899300:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758509696 00000100:00100000:3.0:1789061570.899380:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 279 00000100:00100000:3.0:1789061570.899392:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:9976:x1875966758509696:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789061570.899946:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:9976:x1875966758509696:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 552us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061570.899955:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 279 00000100:00100000:0.0:1789061570.915379:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061570.915541:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758509824 00000100:00100000:2.0:1789061570.915557:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758509824 00000100:00100000:2.0:1789061570.915660:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 280 00000100:00100000:2.0:1789061570.915674:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:9976:x1875966758509824:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789061570.916014:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:9976:x1875966758509824:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 341us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061570.916024:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 280 00000100:00100000:0.0:1789061571.300126:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061571.300210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061571.300258:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061571.300311:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061571.300365:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758510208 00000100:00100000:0.0:1789061571.300378:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758510208 00000100:00100000:0.0:1789061571.300459:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:0.0:1789061571.300471:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758510208:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061571.300552:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758509952 00000100:00100000:1.0:1789061571.300560:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758509952 00000100:00100000:3.0:1789061571.300569:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758510080 00000100:00100000:3.0:1789061571.300589:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758510080 00000100:00100000:1.0:1789061571.300615:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 281 00000100:00100000:1.0:1789061571.300629:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2355:x1875966758509952:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061571.300669:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758510336 00000100:00100000:3.0:1789061571.300676:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758510336 00000100:00100000:1.0:1789061571.300747:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2355:x1875966758509952:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 119us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061571.300756:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 281 00000100:00080000:1.0:1789061571.300837:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061571.300843:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789061571.301179:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758510208:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 709us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061571.301187:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:3.0:1789061571.314732:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:2.0:1789061571.314756:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:3.0:1789061571.314770:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758510080:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061571.314774:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758510336:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061571.314882:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758510080:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 125us (14772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061571.314891:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:2.0:1789061571.315069:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758510336:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 301us (14856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061571.315079:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 113 00000040:00080000:3.0:1789061571.454388:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789061571.454779:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061572.351036:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779518208:0@lo:400:kworker.0 00000100:00100000:2.0:1789061572.351140:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061572.351203:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779518720:0@lo:400:kworker.0 00000100:00100000:2.0:1789061572.351428:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061572.351468:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789061572.351475:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779518336:0@lo:400:kworker.0 00000100:00100000:2.0:1789061572.351523:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061572.356928:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779518592:0@lo:400:kworker.0 00000100:00100000:0.0:1789061572.357801:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061572.357875:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061572.357885:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779518464:0@lo:400:kworker.0 00000100:00100000:0.0:1789061572.359466:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779518592 00000100:00100000:0.0:1789061572.359484:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779518592 00000100:00100000:0.0:1789061572.359592:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789061572.359606:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779518592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061572.359705:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779518592:12345-0@lo:400:kworker.0 Request processed in 103us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061572.359713:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1789061572.359747:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061572.359792:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779518208 00000100:00100000:0.0:1789061572.359797:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779518208 00000100:00100000:0.0:1789061572.359825:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789061572.359832:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779518208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061572.359867:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779518208:12345-0@lo:400:kworker.0 Request processed in 35us (8728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061572.359874:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789061572.364479:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779518720 00000100:00100000:1.0:1789061572.364510:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779518720 00000100:00080000:1.0:1789061572.364555:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061572.364607:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779518336 00000100:00100000:1.0:1789061572.364611:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779518336 00000100:00100000:1.0:1789061572.364646:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789061572.364658:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779518720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061572.364758:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779518720:12345-0@lo:400:kworker.0 Request processed in 104us (13330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061572.364779:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789061572.364802:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789061572.364809:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779518336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061572.364842:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779518336:12345-0@lo:400:kworker.0 Request processed in 34us (13317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061572.364850:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789061572.365725:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789061572.365799:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7c2b7800 x1875966779518592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061572.365819:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779518592:0@lo:400:kworker.0 00000100:00100000:1.0:1789061572.365898:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779518464 00000100:00100000:1.0:1789061572.365916:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779518464 00000100:00100000:1.0:1789061572.365966:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789061572.365976:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779518464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061572.366040:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779518464:12345-0@lo:400:kworker.0 Request processed in 66us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061572.366047:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1789061572.366196:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061572.366218:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779518464:0@lo:400:kworker.0 00000100:00100000:3.0:1789061572.368398:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779518336:0@lo:400:kworker.0 00000100:00100000:3.0:1789061572.368678:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779518848:0@lo:400:kworker.0 00000100:00100000:3.0:1789061572.368765:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061572.368815:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779518848 00000100:00100000:3.0:1789061572.368824:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779518848 00000100:00100000:3.0:1789061572.368898:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789061572.368911:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875966779518848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061572.368980:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875966779518848:12345-0@lo:400:kworker.0 Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061572.368987:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789061572.369588:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779518848:0@lo:400:kworker.0 00000100:00100000:2.0:1789061572.369608:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779518208:0@lo:400:kworker.0 00000100:00100000:2.0:1789061572.369626:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779518720:0@lo:400:kworker.0 00000100:00080000:2.0:1789061572.369681:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789061572.466973:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1789061572.477770:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061572.861973:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779518976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061572.862084:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061572.866942:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779518976 00000100:00100000:2.0:1789061572.866984:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779518976 00000100:00100000:2.0:1789061572.867057:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789061572.867069:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779518976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789061572.867112:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061572.867310:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779518976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 242us (5224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061572.867318:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789061572.867403:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1789061572.867410:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff971a7cd2dc00, transno 4294967300 00000100:00100000:3.0:1789061572.867522:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779518976:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789061573.519821:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061574.527701:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061575.421992:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779519104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061575.422099:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061575.422252:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779519104 00000100:00100000:2.0:1789061575.422264:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779519104 00000100:00100000:2.0:1789061575.422349:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789061575.422360:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779519104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061575.422406:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061575.422470:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779519104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061575.422477:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1789061575.422553:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75cb1500 x1875966779519104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061575.422575:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779519104:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789061575.422802:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789061575.550459:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061576.422961:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061576.423010:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061576.423050:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061576.423082:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061576.423115:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758510592 00000100:00100000:1.0:1789061576.423127:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758510592 00000100:00100000:1.0:1789061576.423206:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758510848 00000100:00100000:1.0:1789061576.423210:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758510848 00000100:00100000:1.0:1789061576.423237:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:1.0:1789061576.423248:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2354:x1875966758510592:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061576.423346:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2354:x1875966758510592:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 99us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061576.423355:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:1.0:1789061576.423376:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:1.0:1789061576.423383:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2354:x1875966758510848:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061576.423409:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2354:x1875966758510848:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061576.423416:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00080000:1.0:1789061576.423437:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061576.423531:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758510464 00000100:00100000:2.0:1789061576.423536:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758510464 00000100:00100000:2.0:1789061576.423578:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 283 00000100:00100000:2.0:1789061576.423586:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2354:x1875966758510464:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061576.423616:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2354:x1875966758510464:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061576.423622:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 283 00000100:00100000:3.0:1789061576.425161:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758510720 00000100:00100000:3.0:1789061576.425189:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758510720 00000100:00100000:3.0:1789061576.425274:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:3.0:1789061576.425286:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2354:x1875966758510720:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061576.425366:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2354:x1875966758510720:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 83us (2355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061576.425392:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00080000:1.0:1789061576.425524:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789061576.574524:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061577.477194:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779519488:0@lo:400:kworker.0 00000100:00100000:3.0:1789061577.477292:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061577.477372:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061577.477378:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779519616:0@lo:400:kworker.0 00000100:00100000:3.0:1789061577.477401:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061577.477808:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779519488 00000100:00100000:3.0:1789061577.477819:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779519488 00000100:00100000:3.0:1789061577.477888:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789061577.477898:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779519488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061577.477957:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779519488:12345-0@lo:400:kworker.0 Request processed in 61us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061577.477964:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789061577.477987:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779519616 00000100:00100000:3.0:1789061577.477990:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779519616 00000100:00100000:3.0:1789061577.478014:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789061577.478020:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779519616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061577.478045:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779519616:12345-0@lo:400:kworker.0 Request processed in 25us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061577.478051:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789061577.478064:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789061577.478069:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789061577.478195:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75b14380 x1875966779519616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061577.478219:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779519616:0@lo:400:kworker.0 00000100:00100000:3.0:1789061577.478243:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779519488:0@lo:400:kworker.0 00000100:00100000:0.0:1789061577.480375:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779519360:0@lo:400:kworker.0 00000100:00100000:0.0:1789061577.480521:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061577.480567:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779519872:0@lo:400:kworker.0 00000100:00100000:0.0:1789061577.480595:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061577.480641:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789061577.480650:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779519232:0@lo:400:kworker.0 00000100:00100000:0.0:1789061577.480683:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061577.480963:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779519744:0@lo:400:kworker.0 00000100:00100000:0.0:1789061577.480991:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061577.481796:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779519360 00000100:00100000:2.0:1789061577.481822:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779519360 00000100:00100000:2.0:1789061577.481888:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779519744 00000100:00100000:2.0:1789061577.481892:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779519744 00000100:00100000:2.0:1789061577.481928:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789061577.481938:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779519360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061577.483077:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789061577.483098:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779519744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061577.484128:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779519872 00000100:00100000:0.0:1789061577.484142:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779519872 00000100:00100000:0.0:1789061577.484228:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789061577.484239:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779519872:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789061577.484741:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061577.484748:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061577.484776:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779519232 00000100:00100000:1.0:1789061577.484782:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779519232 00000100:00100000:1.0:1789061577.484822:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789061577.484831:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779519232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061577.484990:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779519360:12345-0@lo:400:kworker.0 Request processed in 3050us (4468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061577.485000:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789061577.485329:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779519744:12345-0@lo:400:kworker.0 Request processed in 2239us (4335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061577.485338:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789061577.488687:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779519872:12345-0@lo:400:kworker.0 Request processed in 4436us (8075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061577.488780:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789061577.491351:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779519232:12345-0@lo:400:kworker.0 Request processed in 6507us (10652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061577.491401:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789061577.499888:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779519232:0@lo:400:kworker.0 00000100:00100000:0.0:1789061577.499919:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779519744:0@lo:400:kworker.0 00000100:00100000:0.0:1789061577.499933:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779519360:0@lo:400:kworker.0 00000100:00100000:0.0:1789061577.499946:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779519872:0@lo:400:kworker.0 00010000:00010000:3.0:1789061577.598416:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061577.981885:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779520000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061577.981988:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061577.983734:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779520000 00000100:00100000:2.0:1789061577.983752:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779520000 00000100:00100000:2.0:1789061577.983827:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789061577.983840:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779520000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789061577.983889:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061577.983987:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779520000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061577.983995:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789061577.984412:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779520000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789061578.621845:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061579.647687:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061580.542282:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061580.542310:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779520128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061580.542390:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061580.542731:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779520128 00000100:00100000:2.0:1789061580.542741:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779520128 00000100:00080000:1.0:1789061580.542876:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061580.544062:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789061580.544081:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779520128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061580.544133:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061580.544216:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779520128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061580.544223:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1789061580.544329:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75cb1500 x1875966779520128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061580.544350:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779520128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789061580.669942:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061581.543627:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061581.543668:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061581.543713:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061581.543753:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061581.543788:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758511232 00000100:00100000:1.0:1789061581.543812:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758511232 00000100:00100000:1.0:1789061581.543875:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:1.0:1789061581.543885:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2353:x1875966758511232:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061581.543942:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758511104 00000100:00100000:3.0:1789061581.543948:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758511104 00000100:00100000:1.0:1789061581.543953:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2353:x1875966758511232:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061581.543973:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:3.0:1789061581.543979:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758511360 00000100:00100000:3.0:1789061581.543983:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758511360 00000100:00080000:1.0:1789061581.544005:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061581.544011:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00080000:1.0:1789061581.544012:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061581.544022:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2353:x1875966758511104:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061581.544050:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:1.0:1789061581.544061:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2353:x1875966758511360:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061581.544071:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2353:x1875966758511104:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 50us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061581.544111:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2353:x1875966758511360:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 51us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061581.544119:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:0.0:1789061581.544279:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758510976 00000100:00100000:0.0:1789061581.544283:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758510976 00000100:00100000:0.0:1789061581.544321:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 285 00000100:00100000:0.0:1789061581.544328:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2353:x1875966758510976:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061581.544355:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2353:x1875966758510976:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061581.544370:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 285 00000100:00100000:3.0:1789061581.545967:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000040:00080000:0.0:1789061581.694311:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789061581.694514:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061582.593213:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779520384:0@lo:400:kworker.0 00000100:00100000:3.0:1789061582.593349:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779520256:0@lo:400:kworker.0 00000100:00100000:3.0:1789061582.593422:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061582.593477:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779520768:0@lo:400:kworker.0 00000100:00100000:3.0:1789061582.593531:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061582.593595:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779520768 00000100:00100000:0.0:1789061582.593600:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779520640:0@lo:400:kworker.0 00000100:00100000:3.0:1789061582.593606:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779520768 00000100:00100000:0.0:1789061582.593639:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061582.593665:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061582.593673:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779520512:0@lo:400:kworker.0 00000100:00100000:3.0:1789061582.593679:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789061582.593693:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779520768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061582.593700:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061582.593727:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779520640 00000100:00100000:0.0:1789061582.593732:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779520640 00000100:00100000:3.0:1789061582.593762:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779520768:12345-0@lo:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061582.593768:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789061582.593777:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789061582.593780:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779520640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061582.593799:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779520512 00000100:00100000:3.0:1789061582.593805:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779520512 00000100:00100000:0.0:1789061582.593822:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779520640:12345-0@lo:400:kworker.0 Request processed in 45us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061582.593830:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789061582.593839:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789061582.593848:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779520512:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789061582.593867:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971945c92a00 x1875966779520640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061582.593882:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779520640:0@lo:400:kworker.0 00000100:00100000:3.0:1789061582.593889:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779520512:12345-0@lo:400:kworker.0 Request processed in 40us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061582.593897:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789061582.593909:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779520512:0@lo:400:kworker.0 00000100:00080000:3.0:1789061582.593927:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789061582.593934:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061582.593940:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779520256 00000100:00100000:0.0:1789061582.593945:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779520256 00000100:00100000:3.0:1789061582.593962:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779520768:0@lo:400:kworker.0 00000100:00100000:0.0:1789061582.593982:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789061582.593991:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a64f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779520256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061582.594033:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a64f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779520256:12345-0@lo:400:kworker.0 Request processed in 43us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061582.594043:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779520256:0@lo:400:kworker.0 00000100:00100000:0.0:1789061582.594069:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789061582.594365:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061582.594397:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779520896:0@lo:400:kworker.0 00000100:00100000:1.0:1789061582.594424:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061582.594689:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779520384 00000100:00100000:3.0:1789061582.594700:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779520384 00000100:00100000:3.0:1789061582.594730:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789061582.594737:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779520384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061582.594771:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779520384:12345-0@lo:400:kworker.0 Request processed in 35us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061582.594777:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789061582.595305:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779520384:0@lo:400:kworker.0 00000100:00100000:2.0:1789061582.597247:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779520896 00000100:00100000:2.0:1789061582.597326:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779520896 00000100:00100000:0.0:1789061582.597569:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789061582.597583:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779520896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061582.597668:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779520896:12345-0@lo:400:kworker.0 Request processed in 89us (3242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061582.597675:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789061582.597853:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779520896:0@lo:400:kworker.0 00000100:00080000:3.0:1789061582.598110:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789061582.717636:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061583.105699:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779521024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061583.105774:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061583.106007:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779521024 00000100:00100000:1.0:1789061583.106016:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779521024 00000100:00100000:1.0:1789061583.106083:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789061583.106094:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779521024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061583.106128:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061583.106183:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779521024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061583.106190:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789061583.106307:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779521024:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789061583.741779:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061584.766362:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061585.662595:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061585.662619:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779521152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061585.662701:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061585.662778:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779521152 00000100:00100000:2.0:1789061585.662787:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779521152 00000100:00100000:2.0:1789061585.662839:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789061585.662849:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779521152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061585.662883:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061585.662926:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779521152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061585.662932:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1789061585.662973:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75cb1500 x1875966779521152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789061585.663196:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061585.663373:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779521152:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789061585.790803:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061586.660060:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061586.660111:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061586.660371:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758511616 00000100:00100000:3.0:1789061586.660382:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758511616 00000100:00100000:3.0:1789061586.660456:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:3.0:1789061586.660467:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758511616:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061586.660569:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758511616:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 104us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061586.660576:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00080000:1.0:1789061586.661953:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061586.662352:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758511488 00000100:00100000:0.0:1789061586.662364:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758511488 00000100:00100000:0.0:1789061586.662418:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 287 00000100:00100000:0.0:1789061586.662427:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758511488:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061586.662554:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758511488:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 127us (2504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061586.662561:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 287 00000100:00100000:2.0:1789061586.685773:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061586.685846:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061586.685998:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758511744 00000100:00100000:0.0:1789061586.686010:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758511744 00000100:00100000:0.0:1789061586.686098:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1789061586.686108:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2352:x1875966758511744:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:0.0:1789061586.686140:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a8dc 00000100:00080000:0.0:1789061586.686151:0:6702:0:(import.c:65:import_set_state_nolock()) ffff971a75a6c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789061586.686189:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789061586.686465:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+2:2352:x1875966758511744:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 357us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061586.686474:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:0.0:1789061586.686541:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789061586.686700:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061586.687410:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758511872 00000100:00100000:3.0:1789061586.687418:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758511872 00000100:00100000:3.0:1789061586.687558:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:3.0:1789061586.687569:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758511872:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061586.687630:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758511872:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 64us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061586.687650:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00080000:1.0:1789061586.692180:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789061586.814348:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061587.711689:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779521536:0@lo:400:kworker.0 00000100:00100000:1.0:1789061587.711765:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061587.712992:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779521408:0@lo:400:kworker.0 00000100:00100000:2.0:1789061587.714187:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779521280:0@lo:400:kworker.0 00000100:00100000:2.0:1789061587.714243:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061587.714303:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779521792:0@lo:400:kworker.0 00000100:00100000:2.0:1789061587.714343:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779521280 00000100:00100000:2.0:1789061587.714708:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779521280 00000100:00100000:2.0:1789061587.714757:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789061587.714767:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779521280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061587.714893:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779521280:12345-0@lo:400:kworker.0 Request processed in 128us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061587.714918:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789061587.716390:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779521664:0@lo:400:kworker.0 00000100:00100000:0.0:1789061587.716454:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061587.716528:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779521664 00000100:00100000:0.0:1789061587.716537:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779521664 00000100:00100000:0.0:1789061587.716592:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789061587.716601:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75865c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779521664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061587.716653:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75865c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779521664:12345-0@lo:400:kworker.0 Request processed in 54us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061587.716659:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1789061587.716711:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a76197b80 x1875966779521664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061587.716725:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779521664:0@lo:400:kworker.0 00000100:00080000:0.0:1789061587.716748:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061587.718363:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779521536 00000100:00100000:3.0:1789061587.718377:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779521536 00000100:00100000:1.0:1789061587.718390:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061587.718453:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779521792 00000100:00100000:3.0:1789061587.718458:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779521792 00000100:00100000:1.0:1789061587.718461:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779521280:0@lo:400:kworker.0 00000100:00100000:3.0:1789061587.718512:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789061587.718524:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779521536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061587.718532:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789061587.718600:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779521536:12345-0@lo:400:kworker.0 Request processed in 80us (6835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061587.718632:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779521792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061587.718681:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779521792:12345-0@lo:400:kworker.0 Request processed in 54us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061587.718901:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061587.718926:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a76194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779521920:0@lo:400:kworker.0 00000100:00100000:0.0:1789061587.718973:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061587.719185:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789061587.719193:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789061587.719208:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779521408 00000100:00100000:3.0:1789061587.719213:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779521408 00000100:00100000:1.0:1789061587.719240:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779521792:0@lo:400:kworker.0 00000100:00100000:3.0:1789061587.719247:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789061587.719256:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779521408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061587.719297:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779521408:12345-0@lo:400:kworker.0 Request processed in 43us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061587.719305:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789061587.719376:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779521536:0@lo:400:kworker.0 00000100:00100000:1.0:1789061587.719473:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779521920 00000100:00100000:3.0:1789061587.719509:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779521408:0@lo:400:kworker.0 00000100:00100000:1.0:1789061587.719521:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779521920 00000100:00080000:3.0:1789061587.719539:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061587.719544:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061587.719575:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789061587.719585:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779521920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061587.719633:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779521920:12345-0@lo:400:kworker.0 Request processed in 50us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061587.719639:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789061587.719708:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a76194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779521920:0@lo:400:kworker.0 00000001:00100000:3.0:1789061587.784635:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 778edf7b-5a2f-4729-afd3-c88291fdad66 00000020:00000080:3.0:1789061587.784647:0:7660:0:(genops.c:885:class_export_put()) final put ffff971a75a6b800/778edf7b-5a2f-4729-afd3-c88291fdad66 00000020:00000080:1.0:1789061587.784805:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff971a75a6b800/778edf7b-5a2f-4729-afd3-c88291fdad66 for lustre-OST0001 00000020:00000080:1.0:1789061587.784866:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a75a6c000 for lustre-OST0001 00010000:00010000:3.0:1789061587.839860:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061588.222006:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789061588.222046:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779522048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061588.222119:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061588.223228:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779522048 00000100:00100000:2.0:1789061588.223241:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779522048 00000100:00100000:2.0:1789061588.223310:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789061588.223321:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779522048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789061588.223360:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061588.223441:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779522048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061588.223448:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789061588.223607:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779522048:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789061588.862905:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061589.886019:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061590.785025:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779522176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061590.785112:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061590.785229:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779522176 00000100:00100000:0.0:1789061590.785238:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779522176 00000100:00100000:0.0:1789061590.785318:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789061590.785327:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779522176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061590.785384:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061590.785457:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779522176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061590.785464:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1789061590.785675:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061590.786711:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75867100 x1875966779522176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061590.786737:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779522176:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789061590.914129:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061591.779413:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061591.779474:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061591.779532:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061591.779546:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758512000 00000100:00100000:0.0:1789061591.779561:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758512000 00000100:00100000:0.0:1789061591.779726:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 289 00000100:00100000:3.0:1789061591.779733:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758512128 00000100:00100000:3.0:1789061591.779742:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758512128 00000100:00100000:0.0:1789061591.779742:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2355:x1875966758512000:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061591.779798:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758512256 00000100:00100000:3.0:1789061591.779802:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758512256 00000100:00100000:3.0:1789061591.779830:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:3.0:1789061591.779839:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758512128:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061591.779856:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2355:x1875966758512000:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 118us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061591.779866:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 289 00000100:00100000:3.0:1789061591.779898:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758512128:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 48us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061591.779905:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:3.0:1789061591.779922:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:3.0:1789061591.779929:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758512256:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061591.779956:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2355:x1875966758512256:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061591.779963:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00080000:3.0:1789061591.779988:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1789061591.935404:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789061591.935659:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061592.831468:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779522432:0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.831566:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061592.831625:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779522944:0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.831660:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061592.831692:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789061592.831698:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779522304:0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.831726:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061592.831746:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779522816:0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.831766:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061592.831806:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779522688:0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.831828:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061592.831847:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789061592.831852:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779522560:0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.831885:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061592.831913:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779522432 00000100:00100000:2.0:1789061592.831921:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779522432 00000100:00100000:2.0:1789061592.831963:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779522816 00000100:00100000:2.0:1789061592.831966:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779522816 00000100:00100000:2.0:1789061592.831986:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779522560 00000100:00100000:2.0:1789061592.831988:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779522560 00000100:00100000:2.0:1789061592.832004:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789061592.832012:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779522432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.832061:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779522432:12345-0@lo:400:kworker.0 Request processed in 50us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061592.832067:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789061592.832085:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789061592.832091:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779522816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.832118:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779522816:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061592.832123:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789061592.832136:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789061592.832142:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779522560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.832172:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779522560:12345-0@lo:400:kworker.0 Request processed in 30us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061592.832177:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789061592.832196:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779522944 00000100:00100000:2.0:1789061592.832206:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779522944 00000100:00100000:2.0:1789061592.832233:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779522688 00000100:00100000:2.0:1789061592.832235:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779522688 00000100:00100000:2.0:1789061592.832252:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789061592.832258:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779522944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.832288:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779522944:12345-0@lo:400:kworker.0 Request processed in 31us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061592.832295:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789061592.832306:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789061592.832312:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779522688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.832337:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779522688:12345-0@lo:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061592.832342:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789061592.832360:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779522304 00000100:00100000:2.0:1789061592.832363:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779522304 00000100:00100000:2.0:1789061592.832387:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789061592.832394:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779522304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.832423:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779522304:12345-0@lo:400:kworker.0 Request processed in 30us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061592.832429:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1789061592.832466:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061592.832471:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061592.832473:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061592.832524:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779522560:0@lo:400:kworker.0 00010000:00080000:2.0:1789061592.832538:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7cb7d880 x1875966779522688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061592.832550:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779522688:0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.832583:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779522304:0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.832592:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779522816:0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.832602:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779522432:0@lo:400:kworker.0 00000100:00100000:2.0:1789061592.832611:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779522944:0@lo:400:kworker.0 00010000:00010000:3.0:1789061592.957822:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061593.342667:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779523072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061593.342743:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061593.342827:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779523072 00000100:00100000:0.0:1789061593.342834:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779523072 00000100:00100000:0.0:1789061593.342901:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789061593.342911:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779523072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061593.342947:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061593.342992:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779523072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061593.342999:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789061593.343230:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779523072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789061593.981778:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789061594.001225:0:11874:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 13:33:11 (1789061591) 00010000:00010000:3.0:1789061595.007059:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061595.885414:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061595.885873:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758512384 00000100:00100000:3.0:1789061595.885887:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758512384 00000100:00100000:3.0:1789061595.886049:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1789061595.886065:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:10246:x1875966758512384:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061595.886093:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061595.886155:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9a9a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a03f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061595.886244:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a9ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061595.886261:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061595.886278:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061595.886323:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789061595.886328:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789061595.886376:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061595.886423:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9a9a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a03f expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061595.886448:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a9ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a03f expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061595.886458:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636e00) 00010000:00010000:3.0:1789061595.886461:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789061595.886466:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476600, rc 0) 00000100:00080000:2.0:1789061595.886841:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061595.887432:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:10246:x1875966758512384:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1366us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061595.887444:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:0.0:1789061595.897299:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061595.898158:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758512512 00000100:00100000:2.0:1789061595.898171:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758512512 00000100:00100000:2.0:1789061595.898301:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1789061595.898315:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:10247:x1875966758512512:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061595.898346:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061595.898375:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9a9b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a046 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.898466:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9a9bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.898504:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9a9bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.898538:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9a9bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.898559:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9a9c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.898566:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9a9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.898588:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9a9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.898912:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f800/0x427fa11dc4a9a9ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.898932:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f800/0x427fa11dc4a9a9ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.898940:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f800/0x427fa11dc4a9a9ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061595.898978:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789061595.898982:0:8391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061595.899012:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f800/0x427fa11dc4a9a9ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899025:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9a9bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899032:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9a9bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899040:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9a9bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899047:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061595.899052:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9a9bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899061:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9a9bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899083:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636e00) 00010000:00010000:2.0:1789061595.899086:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061595.899093:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9a9bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899100:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9a9bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899117:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9a9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899123:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9a9c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899130:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9a9c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899135:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fe00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061595.899138:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9a9c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899144:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9a9c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899152:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff971a613b5400) 00010000:00010000:2.0:1789061595.899155:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061595.899158:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9a9c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899164:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9a9c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899230:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9a9b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a046 expref: 8 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899248:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f800/0x427fa11dc4a9a9ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a046 expref: 7 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061595.899255:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff971a613b5200) 00010000:00010000:2.0:1789061595.899258:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061595.899260:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f800, rc 0) 00000100:00100000:2.0:1789061595.899354:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+7:10247:x1875966758512512:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1042us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061595.899363:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1789061595.901792:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061595.901833:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779523200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061595.901928:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061595.902153:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779523200 00000100:00100000:0.0:1789061595.902163:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779523200 00000100:00100000:0.0:1789061595.902240:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789061595.902252:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779523200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061595.902295:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061595.902350:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779523200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061595.902358:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1789061595.902381:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061595.902462:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a75864380 x1875966779523200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061595.902574:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779523200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061595.906435:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061595.906748:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758512768 00000100:00100000:0.0:1789061595.906761:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758512768 00000100:00100000:0.0:1789061595.906940:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1789061595.906953:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+7:10247:x1875966758512768:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789061595.906982:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061595.907019:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9a9d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a04d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.907119:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9a9d8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.907315:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9a9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.907330:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9a9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.907538:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9a9df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.907561:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9a9df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.907587:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9a9df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.907967:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a9e6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.907976:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.907984:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061595.907995:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789061595.908147:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9a9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908155:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9a9d8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908161:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9a9d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908167:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596da00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061595.908172:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9a9d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908179:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9a9d8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908192:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff971a613b5200) 00010000:00010000:0.0:1789061595.908195:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061595.908221:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9a9d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908228:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9a9d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908244:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9a9df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908251:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9a9df lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908256:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9a9df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908262:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596ce00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061595.908265:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9a9df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908271:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9a9df lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908282:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff971a610eea00) 00010000:00010000:0.0:1789061595.908284:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061595.908287:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9a9df lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908292:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9a9df lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908869:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9a9d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a04d expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908901:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a04d expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061595.908908:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee800) 00010000:00010000:0.0:1789061595.908911:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061595.908913:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c200, rc 0) 00000100:00100000:0.0:1789061595.908991:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+9:10247:x1875966758512768:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2040us (2571us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789061595.909000:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:1.0:1789061595.913874:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061595.914141:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758512896 00000100:00100000:3.0:1789061595.914176:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758512896 00000100:00100000:3.0:1789061595.914252:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:3.0:1789061595.914265:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+9:10247:x1875966758512896:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789061595.914417:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+9:10247:x1875966758512896:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 153us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061595.914426:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00010000:00010000:3.0:1789061596.029900:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789061596.030216:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789061596.913884:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061596.913944:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061596.913981:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061596.914018:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758513280 00000100:00100000:0.0:1789061596.914031:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758513280 00000100:00100000:0.0:1789061596.914442:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758513152 00000100:00100000:0.0:1789061596.914448:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758513152 00000100:00100000:0.0:1789061596.914479:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:0.0:1789061596.914516:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2354:x1875966758513280:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061596.914615:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2354:x1875966758513280:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 127us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061596.914622:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:0.0:1789061596.914640:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:0.0:1789061596.914647:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2354:x1875966758513152:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061596.914668:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2354:x1875966758513152:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 23us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061596.914686:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00080000:0.0:1789061596.914711:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061596.914905:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758513024 00000100:00100000:2.0:1789061596.914911:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758513024 00000100:00100000:2.0:1789061596.914954:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 291 00000100:00100000:2.0:1789061596.914962:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2354:x1875966758513024:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061596.914989:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2354:x1875966758513024:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061596.914996:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 291 00010000:00010000:3.0:1789061597.053783:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061597.952181:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779523328:0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.952231:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779523456:0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.952317:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061597.952378:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779523968:0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.952406:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061597.952465:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779523584:0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.952513:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061597.952535:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061597.952541:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779523712:0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.952581:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061597.952618:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779523456 00000100:00100000:2.0:1789061597.952628:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779523456 00000100:00100000:2.0:1789061597.952682:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779523584 00000100:00100000:2.0:1789061597.952685:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779523584 00000100:00100000:2.0:1789061597.952721:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789061597.952731:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779523456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.952803:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779523456:12345-0@lo:400:kworker.0 Request processed in 73us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061597.952811:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789061597.952832:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789061597.952838:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779523584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.952867:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779523584:12345-0@lo:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061597.952873:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789061597.952892:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779523968 00000100:00100000:2.0:1789061597.952896:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779523968 00000100:00100000:2.0:1789061597.952922:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779523712 00000100:00100000:2.0:1789061597.952925:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779523712 00000100:00100000:2.0:1789061597.952946:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789061597.952952:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779523968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.952984:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779523968:12345-0@lo:400:kworker.0 Request processed in 32us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061597.952990:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789061597.953008:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789061597.953013:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779523712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.953038:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779523712:12345-0@lo:400:kworker.0 Request processed in 25us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061597.953044:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1789061597.953070:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061597.953074:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061597.953078:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061597.953120:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061597.953144:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779523840:0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.953166:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061597.953195:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779523328 00000100:00100000:2.0:1789061597.953199:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779523328 00000100:00100000:2.0:1789061597.953229:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789061597.953235:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779523328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.953268:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779523328:12345-0@lo:400:kworker.0 Request processed in 33us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061597.953274:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00010000:00080000:2.0:1789061597.953329:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971a7cb7d880 x1875966779523712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061597.953346:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779523712:0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.953360:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779523584:0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.953390:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779523328:0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.953604:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779523456:0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.953616:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779523968:0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.953641:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779523840 00000100:00100000:2.0:1789061597.953644:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779523840 00000100:00100000:2.0:1789061597.953669:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789061597.953675:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779523840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061597.953705:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779523840:12345-0@lo:400:kworker.0 Request processed in 30us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061597.953711:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1789061597.953724:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061597.953738:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779523840:0@lo:400:kworker.0 00000001:00080000:3.0:1789061598.025829:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:3.0:1789061598.081560:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061598.132798:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.132936:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758513408 00000100:00100000:2.0:1789061598.132950:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758513408 00000100:00100000:2.0:1789061598.133222:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1789061598.133236:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:10290:x1875966758513408:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061598.133266:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061598.133296:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9a9f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a054 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133388:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9a9fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133419:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9a9fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133433:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9a9fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133450:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133474:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133482:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133792:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9a9fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133801:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9a9fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133807:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9a9fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133813:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ee00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061598.133929:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9a9fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133940:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9a9fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133956:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636e00) 00010000:00010000:2.0:1789061598.133960:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061598.133966:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9a9fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133974:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9a9fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.133989:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.134002:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.134008:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.134013:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fc00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061598.134016:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.134023:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.134030:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff971a613b5700) 00010000:00010000:2.0:1789061598.134033:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061598.134035:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.134041:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.134088:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9a9f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a054 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.134098:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636e00) 00010000:00010000:2.0:1789061598.134101:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061598.134104:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9a9f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a054 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.134114:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e800, rc 0) 00000100:00080000:3.0:1789061598.134934:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061598.135037:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:10290:x1875966758513408:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1800us (2249us total) trans 0 rc 301/301 00000100:00100000:2.0:1789061598.135049:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1789061598.141684:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.143302:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758513664 00000100:00100000:2.0:1789061598.143323:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758513664 00000100:00100000:2.0:1789061598.143410:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1789061598.143423:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+8:10290:x1875966758513664:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:2.0:1789061598.143639:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061598.143681:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9a9ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a03f expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.143702:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636e00) 00010000:00010000:2.0:1789061598.143717:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061598.144113:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9aa09 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.144131:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9aa09 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.144143:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9aa09 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.144156:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa10 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.144164:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa10 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.144242:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa10 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061598.147969:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789061598.147993:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9aa09 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.148005:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9aa09 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.148013:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9aa09 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.148019:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061598.148025:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9aa09 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.148033:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9aa09 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.148055:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a613b5700) 00010000:00010000:3.0:1789061598.148058:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061598.148073:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9aa09 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.148143:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9aa09 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061598.148170:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0c85246 reply state 00000000a63b8bb4 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa10 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061598.148181:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061598.148384:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+9:10290:x1875966758513664:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 4957us (6709us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789061598.148580:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00010000:00010000:1.0:1789061598.153481:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa10 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.153522:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa10 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.153532:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa10 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.153541:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fc00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061598.153555:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa10 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.153564:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa10 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.153586:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff971a613b5c00) 00010000:00010000:1.0:1789061598.153589:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061598.153596:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa10 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.153603:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9aa10 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061598.265676:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.265846:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758513792 00000100:00100000:2.0:1789061598.265858:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758513792 00000100:00100000:2.0:1789061598.265942:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:2.0:1789061598.265956:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+8:10298:x1875966758513792:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:2.0:1789061598.265991:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061598.266022:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9aa17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a05b expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.266125:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9aa1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.266144:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9aa1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.266158:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9aa1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061598.266212:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789061598.266217:0:8391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061598.266275:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9aa1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.266309:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9aa17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a05b expref: 10 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.266333:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9aa1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a05b expref: 9 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.266372:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a613b5000) 00010000:00010000:2.0:1789061598.266376:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061598.266380:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e000, rc 0) 00000100:00100000:2.0:1789061598.267393:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+9:10298:x1875966758513792:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 1427us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061598.267405:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:2.0:1789061598.364993:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061598.365235:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758513920 00000100:00100000:0.0:1789061598.365250:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758513920 00000100:00100000:0.0:1789061598.365340:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:0.0:1789061598.365354:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+9:10304:x1875966758513920:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789061598.365382:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061598.365411:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9aa25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a062 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365569:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9aa2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365588:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9aa2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365601:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9aa2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365617:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9aa33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365624:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9aa33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365637:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9aa33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365798:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ca00/0x427fa11dc4a9aa3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365808:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ca00/0x427fa11dc4a9aa3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365826:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ca00/0x427fa11dc4a9aa3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061598.365862:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789061598.365867:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061598.365916:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ca00/0x427fa11dc4a9aa3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365931:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9aa2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365939:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9aa2c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365946:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9aa2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365953:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596ce00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061598.365958:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9aa2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365966:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9aa2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.365980:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a613b5000) 00010000:00010000:0.0:1789061598.365990:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061598.365998:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9aa2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.366005:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9aa2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.366023:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9aa33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.366030:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9aa33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.366036:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9aa33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.366042:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596dc00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061598.366045:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9aa33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.366051:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9aa33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.366059:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff971a610eec00) 00010000:00010000:0.0:1789061598.366063:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061598.366066:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9aa33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.366072:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9aa33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.366115:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9aa25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a062 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.366142:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ca00/0x427fa11dc4a9aa3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a062 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.366150:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:0.0:1789061598.366152:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789061598.366155:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596ca00, rc 0) 00000100:00100000:2.0:1789061598.366342:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+10:10304:x1875966758513920:12345-192.168.204.54@tcp:101:bash.0 Request processed in 989us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061598.366352:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1789061598.372660:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.373535:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758514176 00000100:00100000:2.0:1789061598.373551:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758514176 00000100:00100000:2.0:1789061598.373636:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:2.0:1789061598.373652:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+10:10304:x1875966758514176:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789061598.373683:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061598.373784:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9aa41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a069 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.374362:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9aa48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.374383:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9aa48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.374399:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9aa48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.375426:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9aa4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.375451:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9aa4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.375475:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9aa4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789061598.376853:0:8391:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789061598.378626:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aa56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.378649:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aa56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.378663:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aa56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.378704:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9aa48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.378712:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9aa48 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.378718:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9aa48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.378725:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fe00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061598.378729:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9aa48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.378754:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9aa48 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.378786:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:2.0:1789061598.378790:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061598.378795:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9aa48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.378802:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9aa48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061598.378819:0:8391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081c22538 reply state 00000000508491f1 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9aa4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061598.378828:0:8391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789061598.378869:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9aa41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a069 expref: 13 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.378884:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aa56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a069 expref: 12 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.378891:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:2.0:1789061598.378893:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061598.378896:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e600, rc 0) 00000100:00100000:2.0:1789061598.378979:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+13:10304:x1875966758514176:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5332us (6337us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789061598.378988:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00010000:00010000:1.0:1789061598.381310:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9aa4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.381333:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9aa4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.381342:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9aa4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.381350:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061598.381356:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9aa4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.381364:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9aa4f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.381385:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a613b5e00) 00010000:00010000:1.0:1789061598.381406:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061598.381413:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9aa4f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.381420:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9aa4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061598.385043:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.386206:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758514304 00000100:00100000:2.0:1789061598.386258:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758514304 00000100:00100000:2.0:1789061598.386349:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1789061598.386359:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875966758514304:12345-192.168.204.54@tcp:8:bash.0 00010000:00080000:2.0:1789061598.386395:0:8285:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp t0 exp 0000000000000000 cur 372 last 0 00000020:00000080:2.0:1789061598.386438:0:8285:0:(genops.c:1384:class_connect()) connect: client 778edf7b-5a2f-4729-afd3-c88291fdad66, cookie 0x427fa11dc4a9aa64 00002000:00100000:2.0:1789061598.386450:0:8285:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 778edf7b-5a2f-4729-afd3-c88291fdad66/ffff971946bcd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789061598.386476:0:8285:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789061598.386733:0:8285:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789061598.386784:0:8285:0:(import.c:65:import_set_state_nolock()) ffff971946bcb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789061598.386868:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2352:x1875966758514304:12345-192.168.204.54@tcp:8:bash.0 Request processed in 510us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061598.386876:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1789061598.393907:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.394346:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758514432 00000100:00100000:2.0:1789061598.394359:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758514432 00000100:00100000:2.0:1789061598.394459:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1789061598.394472:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:0:x1875966758514432:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789061598.394547:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061598.394582:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010423245/0x427fa11dc4a9aa6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a070 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789061598.394620:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061598.394644:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1789061598.394650:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061598.394661:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010423245/0x427fa11dc4a9aa6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a070 expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.394706:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010423245/0x427fa11dc4a9aa6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a070 expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.394724:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63ee00, rc 0) 00000100:00100000:2.0:1789061598.394812:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:0:x1875966758514432:12345-192.168.204.54@tcp:101:bash.0 Request processed in 343us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061598.394820:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00080000:3.0:1789061598.395628:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061598.402674:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061598.404615:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758514560 00000100:00100000:0.0:1789061598.404639:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758514560 00000100:00100000:0.0:1789061598.404738:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1789061598.404751:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+7:10304:x1875966758514560:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789061598.404787:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061598.404817:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a077 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.404859:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010423245/0x427fa11dc4a9aa6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a070 expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.404870:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061598.404887:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061598.404893:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.404941:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010423245/0x427fa11dc4a9aa6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a070 expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.404981:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010423245/0x427fa11dc4a9aa6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a070 expref: 8 pid: 6702 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061598.404998:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6701:1875966779524096:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061598.405904:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cfac780 going to sleep for 11 seconds 00000100:00100000:0.0:1789061598.422770:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.422899:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6701:1875966779524096:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061598.422953:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.422984:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596dc00, rc 0) 00000100:00100000:2.0:1789061598.424373:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+8:10304:x1875966758514560:12345-192.168.204.54@tcp:101:bash.0 Request processed in 19616us (21706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061598.424387:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1789061598.426572:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758514688 00000100:00100000:1.0:1789061598.426596:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758514688 00010000:00010000:1.0:1789061598.426669:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010423245/0x427fa11dc4a9aa6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a070 expref: 8 pid: 6702 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061598.426732:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:1.0:1789061598.426745:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758514688:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061598.426779:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061598.426811:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010423245/0x427fa11dc4a9aa6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a070 expref: 8 pid: 6702 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.426828:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010423245/0x427fa11dc4a9aa6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a070 expref: 8 pid: 6702 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.426861:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010423245/0x427fa11dc4a9aa6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a070 expref: 8 pid: 6702 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.426885:0:7648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061598.426890:0:7648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061598.426901:0:7648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.426931:0:7648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.426983:0:7648:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061598.427000:0:7648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c606300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7648:1875966779524224:192.168.204.54@tcp:105: 00000100:00100000:1.0:1789061598.427151:0:7648:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cbf7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789061598.429334:0:7648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c606300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7648:1875966779524224:192.168.204.54@tcp:105: 00010000:00010000:1.0:1789061598.429369:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061598.429448:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758514688:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 2705us (6703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061598.429462:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1789061598.435236:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061598.435347:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758514944 00000100:00100000:1.0:1789061598.435360:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758514944 00000100:00100000:1.0:1789061598.435442:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1789061598.435524:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+12:10304:x1875966758514944:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:2.0:1789061598.436303:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+13:10304:x1875966758514944:12345-192.168.204.54@tcp:35:bash.0 Request processed in 846us (1077us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789061598.436313:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1789061598.466801:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779524352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061598.466905:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061598.467053:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779524352 00000100:00100000:0.0:1789061598.467064:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779524352 00000100:00100000:0.0:1789061598.467146:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789061598.467157:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779524352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061598.467199:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061598.467265:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779524352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061598.467273:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789061598.482425:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779524352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061598.534171:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061598.534277:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758515200 00000100:00100000:3.0:1789061598.534292:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758515200 00000100:00100000:3.0:1789061598.534364:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:3.0:1789061598.534380:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+13:10314:x1875966758515200:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061598.534413:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061598.534441:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9aa79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a07e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061598.534584:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789061598.534739:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9aa79 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a07e expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.535436:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a613b5000) 00010000:00010000:3.0:1789061598.535442:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789061598.535470:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9aa79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a07e expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.535522:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476c00, rc 0) 00000100:00100000:3.0:1789061598.535609:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+14:10314:x1875966758515200:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1233us (1452us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1789061598.535618:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000001:00100000:2.0:1789061598.548747:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 778edf7b-5a2f-4729-afd3-c88291fdad66 00000100:00100000:0.0:1789061598.548943:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.549258:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758515456 00000100:00100000:2.0:1789061598.549272:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758515456 00000100:00100000:2.0:1789061598.549386:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1789061598.549399:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+14:10314:x1875966758515456:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789061598.549831:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+15:10314:x1875966758515456:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 432us (904us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789061598.549840:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1789061598.652549:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061598.652701:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758515584 00000100:00100000:0.0:1789061598.652716:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758515584 00000100:00100000:0.0:1789061598.652812:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:0.0:1789061598.652826:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+15:10320:x1875966758515584:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789061598.652857:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061598.652886:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9aa87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a085 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.652989:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9aa8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.653025:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9aa8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.653040:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9aa8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061598.653087:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789061598.653092:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061598.653118:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9aa8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.653152:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9aa87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a085 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.653174:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9aa8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a085 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.653184:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:0.0:1789061598.653188:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061598.653193:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c600, rc 0) 00000100:00100000:0.0:1789061598.653276:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+16:10320:x1875966758515584:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 453us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061598.653284:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1789061598.658770:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.659786:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758515840 00000100:00100000:2.0:1789061598.659804:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758515840 00000100:00100000:2.0:1789061598.659893:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:2.0:1789061598.659906:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+16:10320:x1875966758515840:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061598.659939:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061598.659969:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9aa95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a08c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.660104:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aa9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.660122:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aa9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.660137:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aa9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061598.660150:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789061598.660343:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9aa95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a08c expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.660370:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aa9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a08c expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.660401:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:2.0:1789061598.660405:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061598.660410:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f400, rc 0) 00000100:00100000:2.0:1789061598.660837:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+18:10320:x1875966758515840:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 931us (2094us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789061598.660846:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1789061598.667538:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061598.667650:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758515968 00000100:00100000:3.0:1789061598.667665:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758515968 00000100:00100000:3.0:1789061598.667772:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1789061598.667785:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c607100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+18:2356:x1875966758515968:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061598.667817:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061598.667850:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aa9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a08c expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.667874:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:3.0:1789061598.667881:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061598.667958:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c607100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+17:2356:x1875966758515968:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 176us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061598.667967:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1789061598.671943:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061598.672091:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758516224 00000100:00100000:0.0:1789061598.672108:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758516224 00000100:00100000:0.0:1789061598.672192:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:0.0:1789061598.672205:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+17:10320:x1875966758516224:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789061598.672238:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061598.672278:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9aaaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a093 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.672407:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aab1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.672424:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aab1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.672439:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aab1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061598.672451:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789061598.675039:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9aaaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a093 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.675280:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aab1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a093 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061598.675292:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:0.0:1789061598.675296:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789061598.675300:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c000, rc 0) 00000100:00100000:0.0:1789061598.675547:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+19:10320:x1875966758516224:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 3343us (3618us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789061598.675557:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1789061598.681543:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061598.681648:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758516352 00000100:00100000:1.0:1789061598.681662:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758516352 00000100:00100000:1.0:1789061598.681737:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1789061598.681748:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758516352:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:1.0:1789061598.681838:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.681864:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.681873:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061598.681878:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061598.681883:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.681926:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061598.681943:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 6 pid: 6701 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061598.681960:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c606680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6702:1875966779524480:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061598.682337:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cbf7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789061598.694719:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061598.695416:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758516480 00000100:00100000:3.0:1789061598.695436:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758516480 00002000:00100000:3.0:1789061598.695535:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff971a7c2b4e00 x1875966758516480/t0(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:19/0 lens 504/0 e 0 to 0 dl 1789061609 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789061598.695549:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a7c2b4e00 with x1875966758516480 ext(0->12) 00010000:00010000:3.0:1789061598.695561:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 7 pid: 6701 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.695603:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 7 pid: 6701 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789061598.695613:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff971a7c2b4e00 00000100:00100000:3.0:1789061598.695662:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1789061598.695674:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2355:x1875966758516480:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:2.0:1789061598.696034:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c606680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6702:1875966779524480:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061598.696065:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061598.699325:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2355:x1875966758516480:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 3640us (4603us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789061598.699348:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:2.0:1789061598.699366:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff971a7c2b4e00 x1875966758516480/t4294967299(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:19/0 lens 504/448 e 0 to 0 dl 1789061609 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789061598.699379:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a7c2b4e00 with x1875966758516480 ext(0->12) 00010000:00010000:2.0:1789061598.699390:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 9 pid: 6701 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.699415:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 9 pid: 6701 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789061598.699424:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff971a7c2b4e00 00000100:00100000:0.0:1789061598.706176:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061598.706294:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758516608 00000100:00100000:3.0:1789061598.706312:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758516608 00010000:00010000:3.0:1789061598.706374:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 9 pid: 6701 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061598.706435:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:3.0:1789061598.706448:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2354:x1875966758516608:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061598.706468:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789061598.706544:0:5836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789061598.706548:0:5836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789061597 00002000:00010000:3.0:1789061598.706550:0:5836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789061597 00002000:00010000:3.0:1789061598.706552:0:5836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789061597 00010000:00010000:3.0:1789061598.706559:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 9 pid: 6701 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.706576:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 9 pid: 6701 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.706635:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e01deac8/0x427fa11dc4a9aa72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a077 expref: 9 pid: 6701 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.706659:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061598.706665:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061598.706672:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.706685:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.706740:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061598.706997:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.707009:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.707039:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.707061:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.707077:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.707085:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061598.707091:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.707101:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.707115:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.707123:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9aabf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061598.707215:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758516352:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 25466us (25684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061598.707225:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1789061598.707355:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2354:x1875966758516608:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 907us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061598.707365:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:3.0:1789061598.713847:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.714301:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758516864 00000100:00100000:2.0:1789061598.714317:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758516864 00000100:00100000:2.0:1789061598.714390:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1789061598.714401:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+19:10320:x1875966758516864:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:2.0:1789061598.714509:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aab1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a093 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789061598.714952:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1789061598.715017:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789061598.718165:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789061598.718653:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.719387:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aa56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a069 expref: 23 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.719401:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.719459:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aa56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a069 expref: 23 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.720047:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aa56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a069 expref: 23 pid: 8391 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061598.720098:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946ac2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1875966779524608:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061598.720235:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ceff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061598.725698:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061598.725825:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758516992 00000100:00100000:3.0:1789061598.725838:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758516992 00010000:00010000:3.0:1789061598.725896:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aa56 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a069 expref: 24 pid: 8391 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061598.725948:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:3.0:1789061598.725960:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+24:2355:x1875966758516992:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061598.725979:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061598.725988:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aa56 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a069 expref: 24 pid: 8391 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.726010:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aa56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a069 expref: 24 pid: 8391 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.726040:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:3.0:1789061598.726055:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.726071:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.726081:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.726107:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061598.726185:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+24:2355:x1875966758516992:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 227us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061598.726194:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00010000:00010000:2.0:1789061598.727973:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aa56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a069 expref: 23 pid: 8391 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061598.728012:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946ac2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1875966779524608:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061598.728044:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.728224:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.728231:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789061598.728428:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789061598.728767:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1789061598.728989:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946ac2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779524736:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789061598.729235:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061598.729283:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ceffcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061598.729715:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779524736 00000100:00100000:1.0:1789061598.729726:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779524736 00000100:00100000:1.0:1789061598.729816:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061598.729829:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875966779524736:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789061598.729937:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875966779524736:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061598.729945:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789061598.730293:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946ac2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779524736:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789061598.731359:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1789061598.731469:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946ac2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779524864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789061598.731674:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061598.731716:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ceff9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061598.731845:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779524864 00000100:00100000:1.0:1789061598.731854:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779524864 00000100:00100000:1.0:1789061598.731912:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789061598.731923:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875966779524864:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789061598.732356:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1875966779524864:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 433us (679us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789061598.732364:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789061598.732933:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946ac2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779524864:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789061598.733033:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1789061598.733207:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.733219:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.733228:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.733236:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061598.733241:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.733250:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.733267:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:2.0:1789061598.733271:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789061598.733276:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.733282:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aac6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789061598.735165:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789061598.737309:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789061598.737346:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372978857481ns, next at 373978848511ns, rc = 0 00000001:00080000:2.0:1789061598.737369:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789061598.737506:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:2.0:1789061598.737513:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789061598.737551:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aab1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a093 expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061598.737728:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+26:10320:x1875966758516864:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 23327us (23895us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789061598.737738:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000020:00080000:2.0:1789061598.737746:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789061598.741862:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061598.741968:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758517120 00000100:00100000:3.0:1789061598.741981:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758517120 00000100:00100000:3.0:1789061598.742052:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1789061598.742065:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+26:10320:x1875966758517120:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061598.742098:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061598.742130:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9aacd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a09a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.742212:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9aacd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a09a expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.742257:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9aacd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a09a expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.742283:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:3.0:1789061598.742287:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061598.742292:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476c00, rc 0) 00000100:00100000:3.0:1789061598.742368:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+27:10320:x1875966758517120:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 306us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061598.742376:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:1.0:1789061598.746650:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061598.746823:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758517376 00000100:00100000:3.0:1789061598.746838:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758517376 00000100:00100000:3.0:1789061598.746916:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1789061598.746928:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a65024c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+27:10320:x1875966758517376:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789061598.747255:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a65024c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+28:10320:x1875966758517376:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 329us (620us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789061598.747265:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1789061598.868203:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.868349:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758517632 00000100:00100000:2.0:1789061598.868363:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758517632 00000100:00100000:2.0:1789061598.868440:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:2.0:1789061598.868453:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+28:10330:x1875966758517632:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061598.868540:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061598.868571:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aad4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0a1 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061598.868703:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789061598.868892:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aad4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0a1 expref: 30 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.868911:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a613b5000) 00010000:00010000:2.0:1789061598.868914:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061598.868921:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aad4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0a1 expref: 30 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.868940:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f400, rc 0) 00000100:00100000:2.0:1789061598.869016:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+29:10330:x1875966758517632:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 565us (831us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1789061598.869024:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:0.0:1789061598.873456:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061598.873783:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758517760 00000100:00100000:3.0:1789061598.873799:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758517760 00000100:00100000:3.0:1789061598.873888:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:3.0:1789061598.873901:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+29:10330:x1875966758517760:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:3.0:1789061598.874012:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aae2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874035:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874088:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874109:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9aae9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874118:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9aae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874125:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9aae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874254:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9aaf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874262:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9aaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874270:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9aaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061598.874327:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9aaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874343:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874349:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aae2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874357:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aae2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874373:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061598.874378:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aae2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874387:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aae2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874402:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:3.0:1789061598.874406:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061598.874412:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aae2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874418:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aae2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874437:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9aae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874442:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9aae9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874448:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9aae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874454:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc85e00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061598.874457:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9aae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874463:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9aae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.874481:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a43636500) 00010000:00010000:3.0:1789061598.874992:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061598.875002:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9aae9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.875009:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9aae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.875031:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9aaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.875037:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9aaf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.875043:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9aaf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.875048:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc84a00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061598.875052:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9aaf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.875059:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9aaf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.875076:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:3.0:1789061598.875079:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061598.875082:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9aaf0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061598.875089:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9aaf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061598.875216:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+29:10330:x1875966758517760:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1314us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061598.875226:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1789061598.878381:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061598.878642:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758518016 00000100:00100000:3.0:1789061598.878656:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758518016 00000100:00100000:3.0:1789061598.878779:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1789061598.878792:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+29:10330:x1875966758518016:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789061598.879249:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+30:10330:x1875966758518016:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 458us (882us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789061598.879259:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1789061598.919865:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.919982:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758518272 00000100:00100000:2.0:1789061598.919995:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758518272 00000100:00100000:2.0:1789061598.920070:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:2.0:1789061598.920090:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+30:10333:x1875966758518272:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061598.920126:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061598.920155:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aaf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0a8 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920261:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aafe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920280:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aafe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920296:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aafe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920315:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920322:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920329:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920473:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ab0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920483:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ab0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920556:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ab0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061598.920567:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789061598.920691:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aafe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920700:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aafe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920707:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aafe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920714:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061598.920719:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aafe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920727:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aafe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920741:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:2.0:1789061598.920745:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061598.920761:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aafe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920768:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9aafe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920786:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920792:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920805:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920811:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fe00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061598.920814:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920821:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920829:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a613b5600) 00010000:00010000:2.0:1789061598.920831:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061598.920834:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920840:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920895:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9aaf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0a8 expref: 33 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920912:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ab0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0a8 expref: 32 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.920919:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:2.0:1789061598.920921:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061598.920924:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63ee00, rc 0) 00000100:00100000:2.0:1789061598.920999:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+32:10333:x1875966758518272:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 911us (1152us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789061598.921016:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:0.0:1789061598.924886:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.924966:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758518400 00000100:00100000:2.0:1789061598.924979:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758518400 00000100:00100000:2.0:1789061598.925043:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1789061598.925054:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+32:10333:x1875966758518400:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1789061598.925153:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.925176:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.925191:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.925225:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.925233:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.925241:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.925247:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061598.925252:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.925260:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.925274:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:2.0:1789061598.925286:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061598.925293:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061598.925300:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061598.925398:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+32:10333:x1875966758518400:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 345us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061598.925406:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1789061598.929903:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061598.930050:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758518656 00000100:00100000:2.0:1789061598.930064:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758518656 00000100:00100000:2.0:1789061598.930143:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1789061598.930155:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+32:10333:x1875966758518656:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789061598.930526:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+33:10333:x1875966758518656:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 372us (637us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789061598.930535:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00010000:00010000:3.0:1789061599.101833:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061599.304554:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061599.306113:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758518912 00000100:00100000:2.0:1789061599.306136:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758518912 00000100:00100000:2.0:1789061599.306234:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1789061599.306248:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+33:10364:x1875966758518912:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1789061599.306280:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061599.306307:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0af expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.306433:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ab28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.306450:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ab28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.307258:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ab28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061599.307275:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789061599.308464:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0af expref: 36 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.308682:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ab28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0af expref: 35 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.308696:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:2.0:1789061599.308700:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061599.308704:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f400, rc 0) 00000100:00100000:2.0:1789061599.309024:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+35:10364:x1875966758518912:12345-192.168.204.54@tcp:101:cat.0 Request processed in 2777us (4485us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789061599.309036:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:1.0:1789061599.315720:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061599.315784:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758519168 00000100:00100000:2.0:1789061599.315860:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758519168 00000100:00100000:2.0:1789061599.315935:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1789061599.315946:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+35:10364:x1875966758519168:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:1.0:1789061599.316232:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061599.316363:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+36:10364:x1875966758519168:12345-192.168.204.54@tcp:35:cat.0 Request processed in 417us (657us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789061599.316372:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1789061599.316531:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758519296 00000100:00100000:3.0:1789061599.316538:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758519296 00000100:00100000:3.0:1789061599.316578:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1789061599.316586:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+36:2356:x1875966758519296:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061599.316599:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061599.316629:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ab28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0af expref: 36 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.316651:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:3.0:1789061599.316656:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061599.316681:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+35:2356:x1875966758519296:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 97us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061599.316689:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1789061599.420945:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061599.421116:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758519552 00000100:00100000:2.0:1789061599.421131:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758519552 00000100:00100000:2.0:1789061599.421210:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:2.0:1789061599.421222:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+35:10370:x1875966758519552:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:2.0:1789061599.421281:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061599.421285:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789061599.421321:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9aa8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a085 expref: 35 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.421345:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:2.0:1789061599.421351:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061599.421370:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0b6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.421991:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.422014:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ab0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0a8 expref: 35 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.422023:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.422080:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ab0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0a8 expref: 35 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.422099:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ab0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0a8 expref: 35 pid: 8391 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061599.422116:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946ac1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779524992:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061599.422243:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ceff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061599.428024:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061599.428149:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946ac1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779524992:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061599.428208:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061599.428381:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758519680 00000100:00100000:3.0:1789061599.428397:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758519680 00010000:00010000:3.0:1789061599.428446:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ab0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0a8 expref: 36 pid: 8391 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061599.428733:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:3.0:1789061599.428757:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+36:2356:x1875966758519680:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061599.428778:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061599.428786:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ab0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0a8 expref: 36 pid: 8391 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.428812:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ab0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0a8 expref: 36 pid: 8391 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.428842:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ab0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0a8 expref: 36 pid: 8391 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.428863:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:3.0:1789061599.428870:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.428881:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.428890:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.428963:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061599.429042:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+35:2356:x1875966758519680:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 297us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061599.429070:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00010000:00010000:2.0:1789061599.434734:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.434767:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061599.435160:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789061599.435445:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0b6 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.436149:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0b6 expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.436164:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:2.0:1789061599.436168:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789061599.436173:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fe00, rc 0) 00000100:00100000:2.0:1789061599.436355:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+35:10370:x1875966758519552:12345-192.168.204.54@tcp:101:dd.0 Request processed in 15132us (15423us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789061599.436367:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:0.0:1789061599.442927:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061599.443189:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758519936 00000100:00100000:2.0:1789061599.443206:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758519936 00000100:00100000:2.0:1789061599.443283:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:2.0:1789061599.443295:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+35:10370:x1875966758519936:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:2.0:1789061599.443701:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.443762:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.443778:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789061599.443844:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1789061599.443870:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008787a22 reply state 000000005c19db9a transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061599.443880:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061599.443986:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+38:10370:x1875966758519936:12345-192.168.204.54@tcp:36:dd.0 Request processed in 692us (1071us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789061599.443994:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000020:00080000:2.0:1789061599.443999:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789061599.455895:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061599.455920:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061599.455929:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061599.455935:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061599.455941:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061599.455950:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061599.455974:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:0.0:1789061599.455977:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061599.455982:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061599.455988:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ab4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061599.735470:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061599.735624:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758520064 00000100:00100000:3.0:1789061599.735642:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758520064 00000100:00100000:3.0:1789061599.735750:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:3.0:1789061599.735765:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+37:10384:x1875966758520064:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:3.0:1789061599.735812:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061599.735844:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9ab52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0bd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.735934:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ab59 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.735952:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ab59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.735966:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ab59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.735985:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85c00/0x427fa11dc4a9ab60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.735992:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85c00/0x427fa11dc4a9ab60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.736000:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85c00/0x427fa11dc4a9ab60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.736262:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ab67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.736300:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0b6 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.736311:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ab67 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.736367:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0b6 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.736388:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0b6 expref: 38 pid: 5852 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061599.736404:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c9e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1875966779525120:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061599.736729:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a460f23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061599.741436:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061599.741667:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758520320 00000100:00100000:2.0:1789061599.741681:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758520320 00000100:00100000:2.0:1789061599.741774:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1789061599.741787:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+39:5593:x1875966758520320:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789061599.742259:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+40:5593:x1875966758520320:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 474us (838us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789061599.742270:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1789061599.743286:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c9e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1875966779525120:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061599.743332:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ab67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061599.746395:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061599.746637:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758520448 00000100:00100000:3.0:1789061599.746653:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758520448 00010000:00010000:3.0:1789061599.746715:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0b6 expref: 40 pid: 5852 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061599.746773:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1789061599.746784:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+40:2356:x1875966758520448:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061599.746909:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061599.746934:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0b6 expref: 40 pid: 5852 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.746948:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0b6 expref: 40 pid: 5852 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.746981:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0b6 expref: 40 pid: 5852 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.747002:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:3.0:1789061599.747009:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ab67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.747020:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ab67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.747029:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ab67 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061599.747128:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061599.747272:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ab67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747282:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ab67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061599.747346:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789061599.747360:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061599.747438:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ab67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747454:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ab67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747467:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ab59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747474:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ab59 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747483:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ab59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747537:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc85e00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061599.747544:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ab59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747552:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ab59 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747563:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:2.0:1789061599.747566:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061599.747570:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ab59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747576:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ab59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747591:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85c00/0x427fa11dc4a9ab60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747607:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85c00/0x427fa11dc4a9ab60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747613:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85c00/0x427fa11dc4a9ab60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747617:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc85c00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061599.747620:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85c00/0x427fa11dc4a9ab60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747626:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85c00/0x427fa11dc4a9ab60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747634:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a43636500) 00010000:00010000:2.0:1789061599.747637:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061599.747640:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85c00/0x427fa11dc4a9ab60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747646:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85c00/0x427fa11dc4a9ab60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747697:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9ab52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0bd expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747714:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ab67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0bd expref: 39 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.747722:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:2.0:1789061599.747724:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061599.747744:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4cc84400, rc 0) 00000100:00100000:3.0:1789061599.747862:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+39:2356:x1875966758520448:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1078us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061599.747873:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:2.0:1789061599.748254:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+38:10384:x1875966758520064:12345-192.168.204.54@tcp:101:stat.0 Request processed in 12492us (12801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061599.748263:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:1.0:1789061599.823776:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061599.824009:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758520704 00000100:00100000:2.0:1789061599.824023:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758520704 00000100:00100000:2.0:1789061599.824179:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:2.0:1789061599.824193:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+38:10390:x1875966758520704:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:2.0:1789061599.824289:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061599.824335:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ab67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0bd expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.824363:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:2.0:1789061599.824370:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061599.824753:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ab6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.824772:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ab6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.824981:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ab6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789061599.825122:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1789061599.825155:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d87fa0d5 reply state 000000001600a47c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ab6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061599.825166:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061599.825371:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+40:10390:x1875966758520704:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 1178us (1616us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789061599.825406:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000020:00080000:2.0:1789061599.825413:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789061599.830968:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ab6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.830993:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ab6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.831003:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ab6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.831010:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061599.831016:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ab6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.831025:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ab6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.831059:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:2.0:1789061599.831063:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061599.831072:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ab6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061599.831078:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ab6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061600.081670:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061600.081963:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758520832 00000100:00100000:2.0:1789061600.081977:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758520832 00000100:00100000:2.0:1789061600.082081:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:2.0:1789061600.082095:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+39:10404:x1875966758520832:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:2.0:1789061600.082152:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061600.082179:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ab75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0c4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082282:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ab7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082300:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ab7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082312:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ab7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082331:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ab83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082338:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ab83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082344:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ab83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082451:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082459:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082467:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061600.082560:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789061600.082571:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061600.082598:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082612:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082621:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ab7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082628:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ab7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082635:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ab7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082641:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fc00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061600.082645:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ab7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082653:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ab7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082666:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:2.0:1789061600.082670:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061600.082674:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ab7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082681:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ab7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082696:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ab83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082712:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ab83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082718:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ab83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082723:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061600.082726:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ab83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082742:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ab83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082749:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a613b5600) 00010000:00010000:2.0:1789061600.082751:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061600.082754:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ab83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.082759:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ab83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.083117:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ab75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0c4 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.083137:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0c4 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.083145:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:2.0:1789061600.083147:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061600.083157:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fe00, rc 0) 00000100:00100000:2.0:1789061600.083247:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+40:10404:x1875966758520832:12345-192.168.204.54@tcp:101:stat.0 Request processed in 1155us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061600.083257:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00080000:3.0:1789061600.083541:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789061600.134936:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061600.217313:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061600.217428:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758521088 00000100:00100000:0.0:1789061600.217475:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758521088 00000100:00100000:0.0:1789061600.217596:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:0.0:1789061600.217608:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+40:10414:x1875966758521088:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789061600.217637:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061600.217663:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9ab91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0cb expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061600.217799:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789061600.217961:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9ab91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0cb expref: 42 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.217980:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a613b5000) 00010000:00010000:0.0:1789061600.217983:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789061600.217989:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9ab91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0cb expref: 42 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.218007:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596d600, rc 0) 00000100:00100000:0.0:1789061600.218111:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+41:10414:x1875966758521088:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 504us (814us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1789061600.218119:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1789061600.227130:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061600.227349:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758521344 00000100:00100000:2.0:1789061600.227362:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758521344 00000100:00100000:2.0:1789061600.227434:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1789061600.227456:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+41:10414:x1875966758521344:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789061600.227838:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+42:10414:x1875966758521344:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 392us (720us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789061600.227847:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1789061600.305867:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061600.307195:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758521600 00000100:00100000:0.0:1789061600.307214:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758521600 00000100:00100000:0.0:1789061600.307306:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:0.0:1789061600.307319:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+42:10420:x1875966758521600:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789061600.307352:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061600.307380:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9ab9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0d2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.307588:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.307610:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0c4 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.307620:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.307667:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0c4 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.307685:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0c4 expref: 43 pid: 5852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061600.307702:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb48000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1875966779525248:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061600.307860:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cfac300 going to sleep for 11 seconds 00000100:00100000:0.0:1789061600.317459:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb48000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1875966779525248:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789061600.317772:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061600.320182:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061600.320474:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758521728 00000100:00100000:3.0:1789061600.320542:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758521728 00010000:00010000:3.0:1789061600.320601:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0c4 expref: 44 pid: 5852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061600.320661:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1789061600.320672:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+44:2355:x1875966758521728:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061600.320692:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061600.320700:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0c4 expref: 44 pid: 5852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061600.320715:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0c4 expref: 44 pid: 5852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061600.320755:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9ab8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0c4 expref: 44 pid: 5852 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061600.320791:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:3.0:1789061600.320796:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061600.320807:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061600.320816:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061600.320853:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061600.320937:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+43:2355:x1875966758521728:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 265us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061600.320945:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00010000:00010000:0.0:1789061600.321819:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.321834:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061600.321861:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789061600.322264:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9ab9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0d2 expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.322288:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0d2 expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.322299:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:0.0:1789061600.322302:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789061600.322306:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c000, rc 0) 00000100:00100000:0.0:1789061600.322376:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+43:10420:x1875966758521600:12345-192.168.204.54@tcp:101:bash.0 Request processed in 15060us (16522us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789061600.322386:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:1.0:1789061600.329107:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061600.329228:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758521984 00000100:00100000:0.0:1789061600.329242:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758521984 00000100:00100000:0.0:1789061600.329315:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:0.0:1789061600.329326:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+43:10420:x1875966758521984:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:0.0:1789061600.330232:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.330259:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.330276:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061600.330361:0:8391:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1789061600.330396:0:8391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef3d8c0c reply state 000000006fa9cca9 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061600.330408:0:8391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789061600.330596:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+46:10420:x1875966758521984:12345-192.168.204.54@tcp:36:bash.0 Request processed in 1268us (1503us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789061600.330605:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000020:00080000:0.0:1789061600.330611:0:8391:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789061600.334447:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.334471:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.334481:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.334538:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061600.334545:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.334554:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.334577:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:0.0:1789061600.334580:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061600.334586:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.334592:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061600.342467:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061600.343639:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758522112 00000100:00100000:2.0:1789061600.343658:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758522112 00000100:00100000:2.0:1789061600.343755:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:2.0:1789061600.343769:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+45:10420:x1875966758522112:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789061600.343806:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061600.343832:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9abbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.343957:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9abc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.343975:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0d2 expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.343986:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9abc2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.344358:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0d2 expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.344380:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0d2 expref: 46 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061600.344399:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946ac1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779525376:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061600.344773:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a429d4480 going to sleep for 11 seconds 00000100:00100000:2.0:1789061600.351946:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061600.352099:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946ac1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779525376:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789061600.352135:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9abc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061600.353320:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758522240 00000100:00100000:1.0:1789061600.353337:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758522240 00010000:00010000:1.0:1789061600.353395:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0d2 expref: 47 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061600.353472:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:1.0:1789061600.353482:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+47:2355:x1875966758522240:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061600.353557:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061600.353566:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0d2 expref: 47 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.353581:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0d2 expref: 47 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.353606:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9aba6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0d2 expref: 47 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.353625:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:1.0:1789061600.353630:0:7648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9abc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.353641:0:7648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9abc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.353649:0:7648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9abc2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.353674:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061600.353763:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+46:2355:x1875966758522240:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 281us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061600.353771:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00010000:00010000:0.0:1789061600.354435:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9abc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.354446:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9abc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061600.354551:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789061600.354556:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061600.354585:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9abc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.354628:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9abbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0d9 expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.354652:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9abc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0d9 expref: 45 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.354661:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:0.0:1789061600.354665:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061600.354668:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f400, rc 0) 00000100:00100000:0.0:1789061600.354734:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+45:10420:x1875966758522112:12345-192.168.204.54@tcp:101:bash.0 Request processed in 10959us (12273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061600.354743:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:2.0:1789061600.358693:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061600.359242:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758522496 00000100:00100000:3.0:1789061600.359278:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758522496 00000100:00100000:3.0:1789061600.359362:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1789061600.359376:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a65027c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+45:10420:x1875966758522496:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1789061600.360682:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a65027c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+46:10420:x1875966758522496:12345-192.168.204.54@tcp:35:bash.0 Request processed in 1300us (2000us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789061600.360696:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:1.0:1789061600.485464:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061600.487353:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758522752 00000100:00100000:2.0:1789061600.487374:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758522752 00000100:00100000:2.0:1789061600.487581:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1789061600.487595:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+46:10430:x1875966758522752:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061600.487629:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061600.487658:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9abc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0e0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061600.488320:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789061600.488540:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9abc9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0e0 expref: 48 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.488559:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a613b5000) 00010000:00010000:2.0:1789061600.488562:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061600.488568:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9abc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0e0 expref: 48 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.488611:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fc00, rc 0) 00000100:00100000:2.0:1789061600.488784:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+47:10430:x1875966758522752:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1191us (3334us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1789061600.488793:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1789061600.495136:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061600.495244:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758522880 00000100:00100000:0.0:1789061600.495256:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758522880 00000100:00100000:0.0:1789061600.495332:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:0.0:1789061600.495344:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+47:10430:x1875966758522880:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:0.0:1789061600.495453:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abd7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495536:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495551:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495571:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495579:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495587:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495708:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9abe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495718:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9abe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495737:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9abe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061600.495793:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9abe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495808:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495816:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abd7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495836:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495843:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061600.495848:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495857:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abd7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495871:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:0.0:1789061600.495875:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061600.495882:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495889:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495905:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495911:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495918:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495923:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596da00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061600.495926:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495941:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495950:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a610eec00) 00010000:00010000:0.0:1789061600.495952:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061600.495955:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abde lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495961:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495981:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9abe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495987:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9abe5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.495993:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9abe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.496000:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596ce00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061600.496002:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9abe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.496009:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9abe5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.496016:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:0.0:1789061600.496018:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061600.496021:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9abe5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.496036:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9abe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061600.496336:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+47:10430:x1875966758522880:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 991us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061600.496347:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1789061600.505146:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061600.505322:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758523136 00000100:00100000:2.0:1789061600.505335:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758523136 00000100:00100000:2.0:1789061600.505413:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1789061600.505427:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+47:10430:x1875966758523136:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789061600.505828:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+48:10430:x1875966758523136:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 403us (697us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789061600.505837:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1789061600.582547:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061600.582663:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758523392 00000100:00100000:0.0:1789061600.582679:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758523392 00000100:00100000:0.0:1789061600.582773:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:0.0:1789061600.582785:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+48:10433:x1875966758523392:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789061600.582817:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061600.582841:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9abec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0e7 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.582932:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abf3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.582949:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.582962:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.582976:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.582983:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.583007:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.583458:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9ac01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.583471:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9ac01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.583481:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9ac01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061600.583534:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789061600.583658:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.583666:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abf3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.583674:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.583680:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596da00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061600.583685:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.583693:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abf3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.583708:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:0.0:1789061600.583711:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061600.583739:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.583745:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9abf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.584254:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.584265:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.584270:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.584275:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061600.584279:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.584285:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.584296:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a610eec00) 00010000:00010000:0.0:1789061600.584298:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061600.584302:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abfa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.584308:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9abfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.584375:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9abec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0e7 expref: 51 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.584409:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9ac01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0e7 expref: 50 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061600.584418:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:0.0:1789061600.584420:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061600.584424:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596dc00, rc 0) 00000100:00100000:0.0:1789061600.584871:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+50:10433:x1875966758523392:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 2085us (2389us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789061600.584881:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:1.0:1789061600.594175:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061600.594227:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061600.594314:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758523520 00000100:00100000:3.0:1789061600.594328:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758523520 00000100:00100000:3.0:1789061600.594415:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1789061600.594428:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+50:2355:x1875966758523520:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061600.594447:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061600.594479:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9ac01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0e7 expref: 50 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061600.594547:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:3.0:1789061600.594553:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061600.594627:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+49:2355:x1875966758523520:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 200us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061600.594635:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:2.0:1789061600.595010:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758523648 00000100:00100000:2.0:1789061600.595018:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758523648 00000100:00100000:2.0:1789061600.595063:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1789061600.595072:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+49:10433:x1875966758523648:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1789061600.595148:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.595168:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.595182:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.595214:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.595241:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.595248:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.595254:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fc00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061600.595260:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.595268:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.595278:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:2.0:1789061600.595281:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061600.595285:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.595291:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061600.595352:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+49:10433:x1875966758523648:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 282us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061600.595360:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:1.0:1789061600.599263:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061600.599416:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758523904 00000100:00100000:2.0:1789061600.599430:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758523904 00000100:00100000:2.0:1789061600.599524:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1789061600.599536:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+49:10433:x1875966758523904:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789061600.599900:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+50:10433:x1875966758523904:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 366us (653us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789061600.599916:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1789061600.820377:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061600.820555:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758524160 00000100:00100000:2.0:1789061600.820568:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758524160 00000100:00100000:2.0:1789061600.820640:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:2.0:1789061600.820652:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+50:10451:x1875966758524160:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1789061600.820683:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061600.820707:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0ee expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.821023:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ac1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.821045:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ac1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.821062:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ac1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061600.821077:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789061600.821318:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0ee expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.821341:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ac1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0ee expref: 52 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.821350:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:2.0:1789061600.821354:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789061600.821358:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e800, rc 0) 00000100:00100000:2.0:1789061600.821556:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+52:10451:x1875966758524160:12345-192.168.204.54@tcp:101:cat.0 Request processed in 904us (1192us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789061600.821564:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:0.0:1789061600.877338:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061600.880522:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758524288 00000100:00100000:2.0:1789061600.880547:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758524288 00000100:00100000:2.0:1789061600.880704:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:2.0:1789061600.880730:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+52:10452:x1875966758524288:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061600.880777:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061600.880807:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0f5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.880901:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ac32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.880919:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ac32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.880933:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ac32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061600.880979:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789061600.880983:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061600.881005:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ac32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.881037:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0f5 expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.881059:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ac32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0f5 expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.881092:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:2.0:1789061600.881095:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061600.881100:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e600, rc 0) 00000100:00100000:2.0:1789061600.881255:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+53:10452:x1875966758524288:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 539us (3932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061600.881264:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1789061600.903642:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061600.903908:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758524672 00000100:00100000:2.0:1789061600.903922:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758524672 00000100:00100000:2.0:1789061600.904011:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1789061600.904033:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+53:10452:x1875966758524672:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789061600.904583:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+54:10452:x1875966758524672:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 551us (956us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789061600.904592:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1789061600.917733:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061600.923469:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758524800 00000100:00100000:1.0:1789061600.923506:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758524800 00000100:00100000:1.0:1789061600.924015:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1789061600.924040:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+54:10452:x1875966758524800:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:1.0:1789061600.924061:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789061600.924096:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9abc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0d9 expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.924127:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9ac1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0ee expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.924143:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9aacd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a09a expref: 52 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.924159:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636b00) 00010000:00010000:1.0:1789061600.924175:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061600.924923:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+51:10452:x1875966758524800:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 889us (7209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061600.924934:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1789061600.931042:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061600.931410:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758524928 00000100:00100000:3.0:1789061600.931426:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758524928 00000100:00100000:2.0:1789061600.931684:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:2.0:1789061600.931698:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+51:10452:x1875966758524928:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:2.0:1789061600.931897:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.931921:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061600.931939:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789061600.934851:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789061600.935355:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789061600.935451:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789061600.936174:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+51:10452:x1875966758524928:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 4466us (5143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061600.936190:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:2.0:1789061600.972456:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061600.972819:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758525056 00000100:00100000:1.0:1789061600.972834:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758525056 00000100:00100000:1.0:1789061600.972917:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1789061600.973290:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+51:10454:x1875966758525056:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789061600.973319:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061600.973347:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9ac40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a0fc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973439:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ac47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973458:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ac47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973474:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ac47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973537:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973546:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973553:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973673:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ac55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973683:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ac55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973690:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ac55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061600.973774:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789061600.973780:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789061600.973813:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ac55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973829:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ac55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973839:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ac47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973846:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ac47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973853:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ac47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973859:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061600.973864:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ac47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973874:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ac47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973889:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:1.0:1789061600.973892:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061600.973899:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ac47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973906:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ac47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973944:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973951:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973957:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973962:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061600.973964:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973970:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973978:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a6af68000) 00010000:00010000:1.0:1789061600.973981:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061600.973984:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.973989:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.974283:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9ac40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0fc expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.974303:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ac55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0fc expref: 52 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061600.974323:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:1.0:1789061600.974326:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789061600.974329:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525e00, rc 0) 00000100:00100000:1.0:1789061600.974590:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+52:10454:x1875966758525056:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1304us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061600.975731:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000004:00080000:0.0:1789061601.021850:0:6731:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375263357837ns, next at 376263354198ns, rc = 0 00000100:00100000:2.0:1789061601.021953:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061601.021983:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779525504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061601.022089:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061601.022428:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779525504 00000100:00100000:0.0:1789061601.022439:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779525504 00000100:00100000:0.0:1789061601.022565:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789061601.022577:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875966779525504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061601.022658:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061601.022737:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875966779525504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061601.022745:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1789061601.022816:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061601.023193:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779525504:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789061601.150681:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061601.150696:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789061601.150853:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789061601.150862:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789061601.151149:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb49c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1875966779525632:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789061601.151270:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cfac780 going to sleep for 11 seconds 00000100:00100000:0.0:1789061601.157149:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb49c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1875966779525632:192.168.204.54@tcp:107:hsm_cdtr.0 00010000:00010000:3.0:1789061601.157561:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061601.163612:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061601.164401:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758525184 00000100:00100000:2.0:1789061601.164416:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758525184 00000100:00100000:2.0:1789061601.164503:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1789061601.164519:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:778edf7b-5a2f-4729-afd3-c88291fdad66+52:10465:x1875966758525184:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789061601.164627:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:778edf7b-5a2f-4729-afd3-c88291fdad66+52:10465:x1875966758525184:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 Request processed in 115us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061601.164636:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1789061601.170595:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061601.171338:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758525312 00000100:00100000:3.0:1789061601.171352:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758525312 00000100:00100000:3.0:1789061601.171432:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:3.0:1789061601.171443:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+52:10465:x1875966758525312:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789061601.171515:0:8391:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789061601.171674:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+52:10465:x1875966758525312:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 233us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061601.171683:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1789061601.180634:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061601.181369:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758525440 00000100:00100000:3.0:1789061601.181385:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758525440 00000100:00100000:3.0:1789061601.181461:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:3.0:1789061601.181474:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+52:10465:x1875966758525440:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789061601.181601:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ac5c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.181625:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ac5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.181642:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ac5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182019:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9ac63 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182046:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9ac63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182062:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9ac63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182101:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182111:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182118:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061601.182183:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789061601.182188:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789061601.182208:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182221:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ac5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182246:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ac5c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182254:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ac5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182261:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc84400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061601.182267:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ac5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182276:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ac5c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182293:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee800) 00010000:00010000:1.0:1789061601.182296:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061601.182302:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ac5c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182309:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84400/0x427fa11dc4a9ac5c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182330:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9ac63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182338:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9ac63 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182344:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9ac63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182350:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc84a00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061601.182362:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9ac63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182371:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9ac63 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182384:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff971a43636100) 00010000:00010000:1.0:1789061601.182386:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061601.182389:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9ac63 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182395:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc84a00/0x427fa11dc4a9ac63 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182421:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182427:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182434:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182440:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061601.182444:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182450:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182461:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:1.0:1789061601.182463:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061601.182475:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.182481:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9ac6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061601.182611:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+52:10465:x1875966758525440:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 1135us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061601.182622:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:1.0:1789061601.189352:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061601.190473:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758525696 00000100:00100000:2.0:1789061601.190539:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758525696 00000100:00100000:2.0:1789061601.190635:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:2.0:1789061601.190649:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+52:10465:x1875966758525696:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061601.190680:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061601.190721:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ac71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a103 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.190894:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ac78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.190912:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ac78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.190926:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ac78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061601.190939:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789061601.191091:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ac78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.191099:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ac78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.191107:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ac78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.191114:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061601.191119:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ac78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.191127:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ac78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.191142:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:2.0:1789061601.191145:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061601.191151:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ac78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.191168:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ac78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.191228:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ac71 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a103 expref: 54 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.191241:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee800) 00010000:00010000:2.0:1789061601.191243:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061601.191247:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ac71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a103 expref: 54 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.191258:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63ee00, rc 0) 00000100:00100000:2.0:1789061601.191359:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+53:10465:x1875966758525696:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 712us (2018us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1789061601.191367:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:3.0:1789061601.194663:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061601.196718:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758525824 00000100:00100000:1.0:1789061601.196742:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758525824 00000100:00100000:1.0:1789061601.196822:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:1.0:1789061601.196833:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+53:10465:x1875966758525824:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789061601.196884:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789061601.197014:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+53:10465:x1875966758525824:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 182us (2362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061601.197021:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:1.0:1789061601.204205:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061601.204399:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758526080 00000100:00100000:3.0:1789061601.204410:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758526080 00000100:00100000:3.0:1789061601.204484:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:3.0:1789061601.204528:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+53:10465:x1875966758526080:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061601.204552:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061601.204556:0:8391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789061601.204587:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ac32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0f5 expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.204628:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:3.0:1789061601.204635:0:8391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061601.204651:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85c00/0x427fa11dc4a9ac86 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a10a expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789061601.205416:0:8391:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789061601.205835:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ac8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.205852:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ac8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.205863:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ac8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.206168:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85c00/0x427fa11dc4a9ac86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a10a expref: 55 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.206189:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ac8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a10a expref: 54 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.206198:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff971a43636400) 00010000:00010000:3.0:1789061601.206200:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061601.206204:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4cc85e00, rc 0) 00000100:00100000:3.0:1789061601.206335:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+54:10465:x1875966758526080:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1808us (2137us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789061601.206344:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:0.0:1789061601.223968:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061601.229888:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758526336 00000100:00100000:2.0:1789061601.229913:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758526336 00000100:00100000:3.0:1789061601.230372:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:3.0:1789061601.230388:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+54:10465:x1875966758526336:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789061601.230469:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061601.232193:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4cc85e00/0x427fa11dc4a9ac8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a10a expref: 54 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232233:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff971a43636400) 00010000:00010000:3.0:1789061601.232253:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061601.232292:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9ac9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232311:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9ac9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232325:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9ac9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232610:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aca2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x96494fae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232637:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x96494fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232650:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x96494fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232823:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9ac9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232832:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9ac9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232856:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9ac9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232862:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476c00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061601.232866:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9ac9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232875:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9ac9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232889:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:3.0:1789061601.232892:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061601.232897:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9ac9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232903:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9ac9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232917:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x96494fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232924:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aca2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x96494fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232930:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aca2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x96494fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232934:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061601.232937:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aca2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x96494fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232954:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aca2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x96494fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232962:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x96494fae (ffff971a43636a00) 00010000:00010000:3.0:1789061601.232964:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061601.232967:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aca2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x96494fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.232973:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9aca2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x96494fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061601.233106:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+53:10465:x1875966758526336:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 2716us (9143us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789061601.233116:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:3.0:1789061601.239838:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061601.240228:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758526464 00000100:00100000:1.0:1789061601.240249:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758526464 00000100:00100000:1.0:1789061601.240338:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:1.0:1789061601.240350:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+53:10465:x1875966758526464:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061601.240378:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061601.240407:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9aca9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a111 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.240454:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9acb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.240511:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9acb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.240528:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9acb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.240649:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9aca9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a111 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.240672:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9acb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a111 expref: 54 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.240682:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff971a6af68000) 00010000:00010000:1.0:1789061601.240685:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789061601.240690:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525600, rc 0) 00000100:00100000:1.0:1789061601.240796:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+54:10465:x1875966758526464:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 446us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061601.240804:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:2.0:1789061601.260876:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061601.261093:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758526720 00000100:00100000:3.0:1789061601.261110:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758526720 00000100:00100000:3.0:1789061601.261188:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1789061601.261202:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+54:10465:x1875966758526720:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789061601.261321:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9acb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.261340:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9acb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.261353:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9acb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789061601.261907:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1789061601.261940:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375503450456ns, next at 376503430738ns, rc = 0 00000004:00010000:0.0:1789061601.262076:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abace0f5 reply state 0000000024b8e18a transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9acb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061601.262093:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789061601.262260:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+56:10465:x1875966758526720:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1056us (1395us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789061601.262375:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:0.0:1789061601.270394:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061601.270667:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758526848 00000100:00100000:3.0:1789061601.270728:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758526848 00000100:00100000:3.0:1789061601.270807:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:3.0:1789061601.270820:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+56:10465:x1875966758526848:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061601.270847:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061601.270871:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9acbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a118 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.270935:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9acbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a118 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.270952:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9acbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a118 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.270972:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff971a6af68000) 00010000:00010000:3.0:1789061601.270976:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061601.270979:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40030800, rc 0) 00010000:00010000:2.0:1789061601.271054:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9acb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061601.271069:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+57:10465:x1875966758526848:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 245us (686us total) trans 0 rc 0/0 00010000:00010000:2.0:1789061601.271079:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9acb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061601.271087:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00010000:00010000:2.0:1789061601.271099:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9acb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.271109:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061601.271116:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9acb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.271141:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9acb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.271161:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff971a6af68000) 00010000:00010000:2.0:1789061601.271164:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789061601.271169:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9acb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.271175:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9acb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061601.277846:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061601.277955:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758526976 00000100:00100000:2.0:1789061601.277970:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758526976 00000100:00100000:2.0:1789061601.278040:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:2.0:1789061601.278051:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875966758526976:12345-192.168.204.54@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789061601.278099:0:8285:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp t0 exp 0000000000000000 cur 375 last 0 00000020:00000080:2.0:1789061601.278146:0:8285:0:(genops.c:1384:class_connect()) connect: client 778edf7b-5a2f-4729-afd3-c88291fdad66, cookie 0x427fa11dc4a9acc5 00002000:00100000:2.0:1789061601.278164:0:8285:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 778edf7b-5a2f-4729-afd3-c88291fdad66/ffff971a75fd7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789061601.278198:0:8285:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789061601.278722:0:8285:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789061601.278763:0:8285:0:(import.c:65:import_set_state_nolock()) ffff971a75fd2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789061601.278847:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2352:x1875966758526976:12345-192.168.204.54@tcp:8:lhsmtool_posix.0 Request processed in 796us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061601.278857:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1789061601.287657:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061601.287810:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758527104 00000100:00100000:1.0:1789061601.287821:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758527104 00000100:00100000:1.0:1789061601.287894:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:1.0:1789061601.287907:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:0:x1875966758527104:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789061601.288418:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061601.421901:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:0:x1875966758527104:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 133982us (134239us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789061601.421918:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000001:00080000:3.0:1789061601.421968:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1789061601.421983:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 778edf7b-5a2f-4729-afd3-c88291fdad66 00000100:00100000:2.0:1789061601.434035:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061601.434195:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758527360 00000100:00100000:0.0:1789061601.434208:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758527360 00000100:00100000:0.0:1789061601.434936:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1789061601.434954:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+56:10465:x1875966758527360:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789061601.436003:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+57:10465:x1875966758527360:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 1048us (1984us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789061601.436025:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1789061601.446643:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061601.447106:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758527616 00000100:00100000:3.0:1789061601.447142:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758527616 00000100:00100000:3.0:1789061601.447229:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:3.0:1789061601.447243:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+57:10465:x1875966758527616:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789061601.448187:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+57:10465:x1875966758527616:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 938us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061601.448200:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:2.0:1789061601.451121:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061601.451335:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758527744 00000100:00100000:3.0:1789061601.451350:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758527744 00000100:00100000:3.0:1789061601.451439:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:3.0:1789061601.451451:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+57:10465:x1875966758527744:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061601.451478:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061601.451712:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9accc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a11f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.451867:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031800/0x427fa11dc4a9acd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.451884:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031800/0x427fa11dc4a9acd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.451895:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031800/0x427fa11dc4a9acd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061601.451937:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789061601.451960:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031800/0x427fa11dc4a9acd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.451992:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9accc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a11f expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.452170:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031800/0x427fa11dc4a9acd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a11f expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.452178:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff971a6af68000) 00010000:00010000:3.0:1789061601.452182:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789061601.452186:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40031800, rc 0) 00000100:00100000:3.0:1789061601.454198:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+58:10465:x1875966758527744:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2731us (3073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061601.454832:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:0.0:1789061601.460752:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061601.464826:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758527872 00000100:00100000:1.0:1789061601.464849:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758527872 00000100:00100000:1.0:1789061601.464951:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:1.0:1789061601.464962:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2355:x1875966758527872:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061601.465006:0:8285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061601.465033:0:8285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099f7ddee/0x427fa11dc4a9acda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a126 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061601.465065:0:8285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2e9e0, blocks: 0x1 00010000:00010000:1.0:1789061601.465092:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1789061601.465097:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061601.465108:0:8285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099f7ddee/0x427fa11dc4a9acda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a126 expref: 6 pid: 8285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.465130:0:8285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099f7ddee/0x427fa11dc4a9acda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a126 expref: 6 pid: 8285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.465145:0:8285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525a00, rc 0) 00000100:00100000:1.0:1789061601.465243:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758527872:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 282us (4505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061601.465250:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:0.0:1789061601.470309:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061601.482542:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758528128 00000100:00100000:3.0:1789061601.482565:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758528128 00000100:00100000:3.0:1789061601.482673:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:3.0:1789061601.482686:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+58:10465:x1875966758528128:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789061601.482851:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+58:10465:x1875966758528128:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 167us (12558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061601.482859:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:1.0:1789061601.502824:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061601.502870:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758528256 00000100:00100000:1.0:1789061601.502882:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758528256 00000100:00100000:1.0:1789061601.502945:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:1.0:1789061601.502956:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:10465:x1875966758528256:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061601.502980:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061601.503004:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9ace1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a12d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.503056:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099f7ddee/0x427fa11dc4a9acda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a126 expref: 7 pid: 8285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.503066:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061601.503071:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061601.503076:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9ace1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a12d expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.503116:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099f7ddee/0x427fa11dc4a9acda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a126 expref: 7 pid: 8285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.503131:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099f7ddee/0x427fa11dc4a9acda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a126 expref: 7 pid: 8285 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061601.503146:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a5cf41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1875966779525760:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061601.503257:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cbf7300 going to sleep for 11 seconds 00000100:00100000:1.0:1789061601.508807:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061601.508853:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758528384 00000100:00100000:1.0:1789061601.508867:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758528384 00010000:00010000:1.0:1789061601.508923:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099f7ddee/0x427fa11dc4a9acda lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a126 expref: 8 pid: 8285 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061601.508967:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:1.0:1789061601.508977:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c96450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2355:x1875966758528384:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061601.509005:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061601.509033:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099f7ddee/0x427fa11dc4a9acda lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a126 expref: 8 pid: 8285 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.509047:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099f7ddee/0x427fa11dc4a9acda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a126 expref: 8 pid: 8285 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.509078:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061601.509083:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061601.509095:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9ace1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a12d expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.509106:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9ace1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a12d expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.509149:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9ace1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a12d expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061601.509165:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a5cf42d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5835:1875966779525888:192.168.204.54@tcp:105: 00000100:00100000:1.0:1789061601.509250:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cbf7780 going to sleep for 11 seconds 00010000:00010000:3.0:1789061601.509678:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099f7ddee/0x427fa11dc4a9acda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a126 expref: 8 pid: 8285 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061601.509712:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a5cf41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1875966779525760:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061601.509747:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9ace1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a12d expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.509760:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524c00, rc 0) 00000100:00100000:3.0:1789061601.509809:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:10465:x1875966758528256:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 6855us (6999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061601.509818:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1789061601.526515:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a5cf42d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5835:1875966779525888:192.168.204.54@tcp:105: 00010000:00010000:2.0:1789061601.526565:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061601.526797:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c96450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758528384:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 17818us (17998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061601.526811:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:2.0:1789061601.539553:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061601.543887:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758528512 00000100:00100000:0.0:1789061601.543939:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758528512 00002000:00100000:0.0:1789061601.544049:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff971946ac1880 x1875966758528512/t0(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:22/0 lens 504/0 e 0 to 0 dl 1789061612 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061601.544081:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971946ac1880 with x1875966758528512 ext(0->8) 00002000:00010000:0.0:1789061601.544089:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971946ac1880 00000100:00100000:0.0:1789061601.544128:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1789061601.544139:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758528512:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789061601.548975:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758528512:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 4825us (9425us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789061601.548996:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:0.0:1789061601.549012:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff971946ac1880 x1875966758528512/t4294967302(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:22/0 lens 504/448 e 0 to 0 dl 1789061612 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061601.549103:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971946ac1880 with x1875966758528512 ext(0->8) 00002000:00010000:0.0:1789061601.549111:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971946ac1880 00000100:00100000:2.0:1789061601.560372:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061601.560476:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758528640 00000100:00100000:3.0:1789061601.560599:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758528640 00000100:00100000:3.0:1789061601.560683:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:3.0:1789061601.560697:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+58:10465:x1875966758528640:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789061601.682689:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+58:10465:x1875966758528640:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 121979us (122310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061601.682734:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000001:00080000:1.0:1789061601.682785:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1789061601.682798:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1789061601.682816:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1789061601.682887:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1789061601.682898:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff971a7ceffcc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789061601.682902:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a75b44800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff971a7ceff540 00000020:00080000:1.0:1789061601.682905:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a75b44400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff971a4892ac00 00000020:00080000:1.0:1789061601.683305:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789061601.683456:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789061601.683479:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a5cf41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779526016:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789061601.683579:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061601.683678:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779526016 00000100:00100000:1.0:1789061601.683688:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779526016 00000100:00100000:1.0:1789061601.683754:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789061601.683764:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875966779526016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789061601.683796:0:8285:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789061601.683841:0:8285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa2e9dd, atime: 0x6aa2e9dd, ctime: 0x6aa2e9dd, blocks: 0x1 00010000:00010000:1.0:1789061601.683851:0:8285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9ace8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.683871:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1789061601.683876:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061601.683884:0:8285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9ace8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.683923:0:8285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9ace8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.683936:0:8285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9ace8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.683945:0:8285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9ace8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.683969:0:8285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789061601.689951:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779526144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789061601.690053:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061601.692429:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779526144 00000100:00100000:0.0:1789061601.692450:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779526144 00000100:00100000:0.0:1789061601.692555:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789061601.693151:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779526144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789061601.693406:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789061601.693411:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789061600 00002000:00010000:0.0:1789061601.693414:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789061601.693416:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789061600 -> 1789061600 00002000:00010000:0.0:1789061601.693419:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789061601.694255:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875966779526016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10485us (10670us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789061601.694269:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1789061601.694314:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061601.694325:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9ace8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.694340:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061601.694346:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9ace8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.694358:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9ace8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.694381:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9ace8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.694410:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9ace8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.694437:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061601.694438:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061601.694440:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061601.694587:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061601.695302:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779526144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2733us (5245us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789061601.695325:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789061601.695356:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758528768 00000100:00100000:0.0:1789061601.695365:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758528768 00000100:00100000:0.0:1789061601.695410:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:0.0:1789061601.695419:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758528768:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1789061601.695513:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789061601.695594:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff971a7cb4bb80/2, rc 0, transno 4294967303 00000100:00100000:0.0:1789061601.695602:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779526144:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1789061601.695639:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff971a5cf41c00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789061601.695645:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a5cf41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779526016:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789061601.772824:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758528768:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 77386us (78220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061601.772841:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000001:00080000:0.0:1789061601.772894:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1789061601.772904:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1789061601.776559:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061601.776612:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758529024 00000100:00100000:3.0:1789061601.776626:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758529024 00000100:00100000:3.0:1789061601.776779:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:3.0:1789061601.776838:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+13:10465:x1875966758529024:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789061601.776912:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061601.776953:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031800/0x427fa11dc4a9acd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a11f expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.776978:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff971a6af68000) 00010000:00010000:3.0:1789061601.776984:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061601.777027:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9acef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.777048:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9acef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.777060:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9acef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061601.778627:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001323d43d reply state 00000000e32e3aa6 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9acef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061601.779206:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061601.779521:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+14:10465:x1875966758529024:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 2683us (2972us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789061601.779531:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00010000:00010000:1.0:1789061601.788026:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9acef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.788051:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9acef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.788061:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9acef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.788069:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061601.788075:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9acef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.788084:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9acef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.788106:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff971a6af68000) 00010000:00010000:1.0:1789061601.788109:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061601.788121:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9acef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.788128:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9acef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061601.788968:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061601.789067:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758529152 00000100:00100000:3.0:1789061601.789080:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758529152 00000100:00100000:3.0:1789061601.789150:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1789061601.789163:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cfdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758529152:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789061601.789562:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789061601.789567:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789061600 -> 1789061599 00002000:00010000:3.0:1789061601.789571:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789061597 00002000:00010000:3.0:1789061601.789573:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789061600 -> 1789061599 00002000:00010000:3.0:1789061601.789576:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789061601.789657:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cfdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2355:x1875966758529152:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 495us (696us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789061601.789665:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:0.0:1789061601.808127:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061601.811815:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758529408 00000100:00100000:1.0:1789061601.811838:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758529408 00000100:00100000:0.0:1789061601.812179:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:0.0:1789061601.812192:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+13:10465:x1875966758529408:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789061601.813132:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.813160:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9acb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a111 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.813171:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.813314:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9acb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a111 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.813333:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9acb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a111 expref: 13 pid: 5853 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061601.813353:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb48700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779526272:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061601.813976:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a575a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1789061601.820096:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb48700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779526272:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789061601.820138:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061601.820906:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061601.821018:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758529536 00000100:00100000:3.0:1789061601.821029:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758529536 00010000:00010000:3.0:1789061601.821085:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9acb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a111 expref: 14 pid: 5853 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061601.821129:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:3.0:1789061601.821142:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+14:2355:x1875966758529536:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061601.821162:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061601.822332:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9acb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a111 expref: 14 pid: 5853 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.822655:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9acb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a111 expref: 14 pid: 5853 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.822690:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9acb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a111 expref: 14 pid: 5853 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.822725:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff971a6af68000) 00010000:00010000:3.0:1789061601.822731:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.822743:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.822753:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.822819:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061601.822922:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+13:2355:x1875966758529536:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1780us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061601.822933:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00010000:00010000:0.0:1789061601.823334:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.823345:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.823401:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.823410:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.823418:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.823425:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061601.823448:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.823457:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.823471:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff971a6af68000) 00010000:00010000:0.0:1789061601.823474:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789061601.823478:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.823484:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9acf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061601.823573:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+12:10465:x1875966758529408:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 11382us (15459us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789061601.823583:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1789061601.830524:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061601.830568:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758529664 00000100:00100000:1.0:1789061601.830591:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758529664 00000100:00100000:1.0:1789061601.830675:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:1.0:1789061601.830688:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2353:x1875966758529664:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789061601.830763:0:8285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.830789:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9ace1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a12d expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.830800:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789061601.830805:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061601.830811:0:8285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.830860:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9ace1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a12d expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.830876:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9ace1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a12d expref: 7 pid: 6702 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061601.830894:0:8285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a5cf40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8285:1875966779526400:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061601.831001:0:8285:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cbf7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061601.839173:0:8285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a5cf40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8285:1875966779526400:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061601.839337:0:8285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061601.844733:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061601.846108:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758529792 00000100:00100000:0.0:1789061601.846130:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758529792 00010000:00010000:0.0:1789061601.846195:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9ace1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a12d expref: 8 pid: 6702 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061601.846803:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:0.0:1789061601.846820:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758529792:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061601.846840:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061601.846870:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9ace1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a12d expref: 8 pid: 6702 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.846887:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9ace1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a12d expref: 8 pid: 6702 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.846935:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9ace1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a12d expref: 8 pid: 6702 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.846956:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789061601.846960:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789061601.846967:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.846978:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.847026:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061601.847077:0:8285:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.847098:0:8285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061601.847107:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758529792:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 289us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061601.847128:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00010000:00010000:3.0:1789061601.847157:0:8285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.847185:0:8285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.847193:0:8285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.847201:0:8285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524000 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061601.847205:0:8285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.847214:0:8285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.847236:0:8285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.847244:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9acfd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061601.847338:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2353:x1875966758529664:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 16648us (16843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061601.847349:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:0.0:1789061601.854953:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061601.855893:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758530048 00000100:00100000:2.0:1789061601.855910:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758530048 00000100:00100000:2.0:1789061601.855993:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:2.0:1789061601.856003:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+12:10465:x1875966758530048:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789061601.856115:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ad04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.856150:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ad04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.856166:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ad04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.856473:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.856513:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9acbe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a118 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.856548:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.856595:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9acbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a118 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.856611:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9acbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a118 expref: 13 pid: 5853 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061601.856629:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779526528:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061601.859151:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a523e8600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061601.862200:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779526528:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061601.862242:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061601.863940:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061601.864100:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758530176 00000100:00100000:2.0:1789061601.864124:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758530176 00010000:00010000:2.0:1789061601.864182:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9acbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a118 expref: 14 pid: 5853 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061601.864229:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:2.0:1789061601.864240:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+14:2354:x1875966758530176:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061601.864457:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061601.864467:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9acbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a118 expref: 14 pid: 5853 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.864542:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9acbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a118 expref: 14 pid: 5853 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.864575:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9acbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a118 expref: 14 pid: 5853 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.864601:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff971a6af68000) 00010000:00010000:2.0:1789061601.864608:0:7648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.864620:0:7648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.864630:0:7648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.866535:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061601.866721:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+13:2354:x1875966758530176:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 2399us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061601.866736:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00010000:00010000:0.0:1789061601.867940:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.867958:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061601.868237:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1789061601.868447:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1789061601.868553:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1789061601.868704:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1875966779526656:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789061601.868803:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061601.868857:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f50d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061601.870285:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779526656 00000100:00100000:2.0:1789061601.870299:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779526656 00000100:00100000:2.0:1789061601.870381:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061601.870398:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875966779526656:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789061601.870832:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875966779526656:12345-0@lo:1000:mdt00_001.0 Request processed in 438us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061601.870842:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789061601.871148:0:5852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789061601.871157:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff971a7cb4bb80, transno 4294967303 00000100:00100000:3.0:1789061601.871184:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1875966779526656:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789061601.872930:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789061601.873048:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1875966779526784:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789061601.873860:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061601.873917:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4349be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061601.874787:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779526784 00000100:00100000:2.0:1789061601.874802:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779526784 00000100:00100000:2.0:1789061601.874876:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789061601.874888:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1875966779526784:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789061601.876506:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1875966779526784:12345-0@lo:1000:mdt00_001.0 Request processed in 482us (1511us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789061601.876535:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789061601.883824:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1875966779526784:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789061601.883904:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.883918:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.883926:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.883933:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061601.883939:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.883948:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.883969:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff971a6af68000) 00010000:00010000:0.0:1789061601.883972:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789061601.883978:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.883984:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ad0b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.884047:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.884053:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac39 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.884085:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.884091:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fc00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061601.884094:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.884101:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac39 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.884110:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:0.0:1789061601.884113:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789061601.884117:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac39 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.884123:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9ac39 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.884198:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.884216:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ac55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0fc expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.884226:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.884282:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ac55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0fc expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061601.884314:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ac55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0fc expref: 16 pid: 5851 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061601.884331:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c60700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779526912:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061601.884557:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f50000 going to sleep for 11 seconds 00000100:00100000:2.0:1789061601.904788:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061601.905859:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c60700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779526912:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789061601.905905:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061601.908359:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758530304 00000100:00100000:1.0:1789061601.908482:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758530304 00010000:00010000:2.0:1789061601.922897:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ac55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0fc expref: 17 pid: 5851 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061601.922977:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:2.0:1789061601.922989:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+17:2356:x1875966758530304:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061601.923019:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061601.923027:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ac55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0fc expref: 17 pid: 5851 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.923044:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ac55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0fc expref: 17 pid: 5851 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.923071:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ac55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a0fc expref: 17 pid: 5851 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.923092:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:2.0:1789061601.923097:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.923109:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.923285:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.923324:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061601.923364:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.923383:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.923399:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.923407:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.923414:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.923420:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061601.923425:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.923432:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.923442:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:3.0:1789061601.923445:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061601.923449:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.923455:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9ad12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061601.923474:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+16:2356:x1875966758530304:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 487us (18701us total) trans 0 rc 0/0 00010000:00010000:3.0:1789061601.923476:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ad04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.923483:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ad04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061601.923483:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00010000:00010000:3.0:1789061601.923508:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ad04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.923514:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ee00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061601.923517:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ad04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.923523:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ad04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.923531:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a613b5600) 00010000:00010000:3.0:1789061601.923534:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789061601.923536:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ad04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061601.923542:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9ad04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061601.923839:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+15:10465:x1875966758530048:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 67836us (68901us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1789061601.923850:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000020:00080000:3.0:1789061601.923854:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789061601.928269:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789061601.928285:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789061601.928327:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789061601.928335:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061601.940477:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061601.940690:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758530560 00000100:00100000:1.0:1789061601.940715:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758530560 00000100:00100000:1.0:1789061601.940785:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1789061601.940799:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+15:10465:x1875966758530560:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789061601.941938:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789061601.942077:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1789061601.942149:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9ad19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.942171:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9ad19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.942186:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9ad19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.942196:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9ad19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.942203:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9ad19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.942210:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9ad19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061601.942244:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061601.942535:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061601.942546:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9ad19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.942553:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061601.942558:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9ad19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.942568:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9ad19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.942585:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff971a6af68200) 00010000:00010000:2.0:1789061601.942589:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789061601.942595:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9ad19 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.942601:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9ad19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061601.942654:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061601.942657:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061601.942659:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061601.942912:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+17:10465:x1875966758530560:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 2109us (2441us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789061601.942926:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000020:00080000:1.0:1789061601.942934:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789061602.020966:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061602.021028:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061602.021093:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061602.021202:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758530816 00000100:00100000:1.0:1789061602.021223:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758530816 00000100:00100000:1.0:1789061602.021315:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1789061602.021328:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2353:x1875966758530816:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061602.021433:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2353:x1875966758530816:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 107us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061602.021441:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1789061602.021468:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758530944 00000100:00100000:1.0:1789061602.021472:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758530944 00000100:00100000:1.0:1789061602.021529:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:1.0:1789061602.021538:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2353:x1875966758530944:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061602.021579:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2353:x1875966758530944:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 42us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061602.021585:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00080000:3.0:1789061602.022471:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061602.022480:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061602.023048:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758530688 00000100:00100000:2.0:1789061602.023065:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758530688 00000100:00100000:2.0:1789061602.023448:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 293 00000100:00100000:2.0:1789061602.023463:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2353:x1875966758530688:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061602.023583:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2353:x1875966758530688:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 124us (2552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061602.023591:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 293 00010000:00010000:3.0:1789061602.182539:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789061602.257263:0:12029:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789061602.257278:0:12029:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789061602.258003:0:12029:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789061602.258012:0:12029:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061602.441895:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061602.442921:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758531200 00000100:00100000:3.0:1789061602.442941:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758531200 00000100:00100000:3.0:1789061602.443033:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:3.0:1789061602.443046:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+17:10475:x1875966758531200:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061602.443080:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061602.443108:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9ad20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a134 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.443266:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031800/0x427fa11dc4a9ad27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.443283:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031800/0x427fa11dc4a9ad27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.443295:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031800/0x427fa11dc4a9ad27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061602.443307:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789061602.443476:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9ad20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a134 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.443525:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031800/0x427fa11dc4a9ad27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a134 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.443536:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:3.0:1789061602.443539:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789061602.443551:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40031800, rc 0) 00000100:00100000:3.0:1789061602.443639:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+19:10475:x1875966758531200:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 595us (2015us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789061602.443648:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00080000:3.0:1789061602.443680:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061602.462387:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061602.465171:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758531328 00000100:00100000:1.0:1789061602.465191:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758531328 00000100:00100000:0.0:1789061602.471141:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:0.0:1789061602.471160:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+19:10475:x1875966758531328:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:0.0:1789061602.471283:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471306:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471319:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471334:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9ad3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471340:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9ad3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471345:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9ad3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471675:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471695:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471702:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061602.471760:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471775:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471781:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471788:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471794:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061602.471806:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471815:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471828:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:0.0:1789061602.471831:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061602.471836:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471849:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471863:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9ad3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471868:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9ad3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471874:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9ad3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471878:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061602.471881:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9ad3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471886:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9ad3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471892:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a610ee000) 00010000:00010000:0.0:1789061602.471895:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061602.471897:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9ad3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471902:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9ad3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471920:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471925:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471935:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471939:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061602.471942:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471947:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471953:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a610eea00) 00010000:00010000:0.0:1789061602.471955:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061602.471957:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.471962:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061602.473968:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+19:10475:x1875966758531328:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 2795us (11580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061602.473986:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:0.0:1789061602.579359:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061602.579614:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758531584 00000100:00100000:3.0:1789061602.579632:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758531584 00000100:00100000:3.0:1789061602.579725:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:3.0:1789061602.579878:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+19:10478:x1875966758531584:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061602.579907:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061602.579933:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9ad4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a13b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.580046:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9ad51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.580066:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9ad51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.580081:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9ad51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.580099:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ad58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.580107:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ad58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.580114:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ad58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581113:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9ad5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581130:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9ad5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581140:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9ad5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061602.581275:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789061602.581480:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9ad51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581593:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9ad51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581601:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9ad51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581608:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030c00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061602.581613:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9ad51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581621:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9ad51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581639:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:3.0:1789061602.581642:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061602.581648:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9ad51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581670:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9ad51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581701:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ad58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581707:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ad58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581713:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ad58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581718:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40031e00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061602.581721:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ad58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581727:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ad58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581929:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a43636a00) 00010000:00010000:3.0:1789061602.581932:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061602.581936:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ad58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.581943:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ad58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.582067:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9ad4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a13b expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.582086:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9ad5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a13b expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.582102:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636400) 00010000:00010000:3.0:1789061602.582105:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061602.582108:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40030400, rc 0) 00000100:00100000:3.0:1789061602.585139:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+21:10478:x1875966758531584:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 5386us (5776us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789061602.585155:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:1.0:1789061602.592152:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061602.592320:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758531712 00000100:00100000:2.0:1789061602.592334:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758531712 00000100:00100000:2.0:1789061602.592460:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:2.0:1789061602.592472:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+21:10478:x1875966758531712:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1789061602.592599:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ad6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.592621:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ad6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.592637:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ad6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.592707:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ad6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.592715:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ad6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.592723:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ad6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.592730:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061602.592735:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ad6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.592744:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ad6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.592759:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636400) 00010000:00010000:2.0:1789061602.592762:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061602.592767:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ad6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.592774:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9ad6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061602.593114:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+21:10478:x1875966758531712:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 641us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061602.593122:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:0.0:1789061602.595342:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061602.595471:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758531968 00000100:00100000:3.0:1789061602.595513:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758531968 00000100:00100000:3.0:1789061602.595579:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1789061602.595589:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a65026450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+21:10478:x1875966758531968:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789061602.596395:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a65026450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+22:10478:x1875966758531968:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 801us (1060us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789061602.596407:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1789061602.652298:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061602.652920:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758532224 00000100:00100000:0.0:1789061602.652934:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758532224 00000100:00100000:0.0:1789061602.653154:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:0.0:1789061602.653166:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+22:10006:x1875966758532224:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789061602.653201:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061602.653256:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9ad74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a142 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.653410:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.653427:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9ad5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a13b expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.653436:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.653477:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9ad5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a13b expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.653525:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9ad5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a13b expref: 23 pid: 5851 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061602.653540:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c60e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779527040:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061602.653695:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f50000 going to sleep for 11 seconds 00000100:00100000:1.0:1789061602.661548:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061602.661650:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758532352 00000100:00100000:3.0:1789061602.661665:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758532352 00010000:00010000:3.0:1789061602.661747:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9ad5f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a13b expref: 24 pid: 5851 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061602.661790:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:3.0:1789061602.661801:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+24:2355:x1875966758532352:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061602.661820:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061602.661829:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9ad5f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a13b expref: 24 pid: 5851 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.661870:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9ad5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a13b expref: 24 pid: 5851 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.661898:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636400) 00010000:00010000:3.0:1789061602.661904:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.661917:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.661925:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.661961:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061602.662046:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+24:2355:x1875966758532352:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 247us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061602.662054:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00010000:00010000:0.0:1789061602.663205:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9ad5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a13b expref: 23 pid: 5851 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061602.663232:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c60e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779527040:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789061602.663265:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.663277:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.663301:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061602.663325:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789061602.663723:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9ad74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a142 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.663751:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a142 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.663759:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636400) 00010000:00010000:0.0:1789061602.663763:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789061602.663766:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c600, rc 0) 00000100:00100000:0.0:1789061602.663842:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+23:10006:x1875966758532224:12345-192.168.204.54@tcp:101:bash.0 Request processed in 10677us (11619us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1789061602.663852:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:1.0:1789061602.667221:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061602.667582:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758532608 00000100:00100000:0.0:1789061602.667596:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758532608 00000100:00100000:0.0:1789061602.667902:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:0.0:1789061602.667915:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+23:10006:x1875966758532608:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:0.0:1789061602.670336:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.670596:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061602.670614:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061602.671128:0:8391:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1789061602.671186:0:8391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce7a0b83 reply state 00000000042d1ef2 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061602.671196:0:8391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789061602.671282:0:8391:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1789061602.671584:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+27:10006:x1875966758532608:12345-192.168.204.54@tcp:36:bash.0 Request processed in 3667us (4371us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1789061602.671593:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 89 00000020:00080000:0.0:1789061602.671600:0:8391:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789061602.674481:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061602.675202:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758532736 00000100:00100000:3.0:1789061602.675218:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758532736 00000100:00100000:3.0:1789061602.675417:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:3.0:1789061602.675430:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+27:10006:x1875966758532736:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789061602.675466:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061602.675536:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9ad90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a149 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.675633:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9ad90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a149 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.675688:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9ad90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a149 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.675713:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636400) 00010000:00010000:3.0:1789061602.675717:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061602.675722:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40031400, rc 0) 00000100:00100000:3.0:1789061602.675968:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+28:10006:x1875966758532736:12345-192.168.204.54@tcp:101:bash.0 Request processed in 540us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061602.675975:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00010000:00010000:2.0:1789061602.676059:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.676068:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.676083:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.676090:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061602.676095:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.676103:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.676116:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636400) 00010000:00010000:2.0:1789061602.676118:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061602.676122:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.676128:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9ad89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061602.684530:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061602.684857:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758532864 00000100:00100000:2.0:1789061602.684873:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758532864 00000100:00100000:2.0:1789061602.685018:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1789061602.685032:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:10006:x1875966758532864:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789061602.685058:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061602.685091:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ad97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a150 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789061602.685130:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa2e9df, atime: 0x6aa2e9dd, ctime: 0x6aa2e9df, blocks: 0xb 00010000:00010000:2.0:1789061602.685162:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1789061602.685167:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061602.685199:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ad97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a150 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.685222:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ad97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a150 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.685238:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e800, rc 0) 00000100:00100000:2.0:1789061602.685324:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:10006:x1875966758532864:12345-192.168.204.54@tcp:101:bash.0 Request processed in 295us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061602.685333:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1789061602.695169:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061602.701111:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758532992 00000100:00100000:2.0:1789061602.701133:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758532992 00002000:00010000:3.0:1789061602.705919:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1789061602.705934:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a5cf40e00 with x1875966758532992 ext(0->18446744073709551615) 00002000:00010000:3.0:1789061602.706430:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971a5cf40e00. 00000100:00100000:3.0:1789061602.706595:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1789061602.706614:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758532992:12345-192.168.204.54@tcp:10:bash.0 00002000:00010000:3.0:1789061602.708120:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789061602.708129:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789061599 -> 1789061601 00002000:00010000:3.0:1789061602.708133:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789061597 -> 1789061597 00002000:00010000:3.0:1789061602.708135:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789061599 -> 1789061601 00002000:00010000:3.0:1789061602.708138:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789061602.708320:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758532992:12345-192.168.204.54@tcp:10:bash.0 Request processed in 1708us (13159us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789061602.708331:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00002000:00010000:3.0:1789061602.708337:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1789061602.708341:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a5cf40e00 with x1875966758532992 ext(0->18446744073709551615) 00002000:00010000:3.0:1789061602.708375:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971a5cf40e00. 00000100:00100000:1.0:1789061602.841560:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061602.842369:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758533120 00000100:00100000:2.0:1789061602.842384:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758533120 00000100:00100000:2.0:1789061602.842469:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:2.0:1789061602.842483:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+27:10492:x1875966758533120:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1789061602.842606:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ad9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.842627:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ad9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.842643:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ad9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.842660:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ada5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.842668:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ada5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.842712:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ada5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843031:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843041:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843049:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061602.843097:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843111:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ad9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843117:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ad9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843124:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ad9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843130:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061602.843135:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ad9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843143:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ad9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843157:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:2.0:1789061602.843167:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061602.843175:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ad9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843181:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9ad9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843198:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ada5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843205:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ada5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843211:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ada5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843217:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061602.843219:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ada5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843226:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ada5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843405:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a613b5d00) 00010000:00010000:2.0:1789061602.843409:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061602.843413:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ada5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843418:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9ada5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843436:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843450:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843456:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843462:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ee00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061602.843465:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843471:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843479:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636400) 00010000:00010000:2.0:1789061602.843482:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061602.843602:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.843611:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061602.843723:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+27:10492:x1875966758533120:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1240us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061602.843732:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:0.0:1789061602.893232:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061602.897016:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758533376 00000100:00100000:3.0:1789061602.897042:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758533376 00000100:00100000:3.0:1789061602.897194:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:3.0:1789061602.897210:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+27:10495:x1875966758533376:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061602.897240:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061602.897269:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9adb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a157 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.897383:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9adba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.897410:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9adba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.897426:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9adba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.897450:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9adc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.897457:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9adc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.897464:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9adc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901162:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901189:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901206:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061602.901237:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789061602.901379:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9adba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901388:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9adba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901396:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9adba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901403:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030c00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061602.901407:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9adba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901416:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9adba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901432:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:2.0:1789061602.901436:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061602.901442:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9adba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901448:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9adba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901467:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9adc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901473:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9adc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901567:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9adc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901574:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061602.901577:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9adc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901585:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9adc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901593:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a43636a00) 00010000:00010000:2.0:1789061602.901596:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061602.901599:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9adc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901605:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9adc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901699:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9adb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a157 expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901721:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a157 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.901729:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636400) 00010000:00010000:2.0:1789061602.901731:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789061602.901734:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63ee00, rc 0) 00000100:00100000:2.0:1789061602.901842:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+29:10495:x1875966758533376:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 4635us (8627us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789061602.901862:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:1.0:1789061602.905959:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061602.906138:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758533504 00000100:00100000:2.0:1789061602.906154:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758533504 00000100:00100000:2.0:1789061602.906237:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:2.0:1789061602.906250:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+29:10495:x1875966758533504:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1789061602.906348:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.906370:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a142 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.906382:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.907575:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a142 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061602.907603:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a142 expref: 29 pid: 5852 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061602.907623:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779527168:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061602.907905:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061602.919840:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779527168:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061602.919840:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:2.0:1789061602.919885:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061602.920161:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758533760 00000100:00100000:0.0:1789061602.920172:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758533760 00000100:00100000:0.0:1789061602.920256:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1789061602.920270:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+30:5594:x1875966758533760:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789061602.925974:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+31:5594:x1875966758533760:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 5691us (6131us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789061602.925993:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1789061602.930899:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061602.931017:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758533888 00000100:00100000:3.0:1789061602.931031:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758533888 00010000:00010000:3.0:1789061602.931087:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a142 expref: 31 pid: 5852 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061602.931166:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1789061602.931179:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+31:2356:x1875966758533888:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061602.931199:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061602.931207:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a142 expref: 31 pid: 5852 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.931224:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a142 expref: 31 pid: 5852 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.931252:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9ad7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a142 expref: 31 pid: 5852 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.931273:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636400) 00010000:00010000:3.0:1789061602.931281:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.931293:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.931303:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061602.931360:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061602.931443:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+30:2356:x1875966758533888:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 267us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061602.931452:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00010000:00010000:1.0:1789061602.931928:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061602.931938:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061602.931980:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061602.932000:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061602.932007:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061602.932013:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061602.932018:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061602.932025:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061602.932037:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636400) 00010000:00010000:1.0:1789061602.932040:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789061602.932045:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061602.932052:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9add6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061602.932120:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+29:10495:x1875966758533504:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 25872us (26178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061602.932142:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:1.0:1789061602.936393:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061602.936603:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758534144 00000100:00100000:3.0:1789061602.936639:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758534144 00000100:00100000:3.0:1789061602.936726:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1789061602.936739:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+29:10495:x1875966758534144:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789061602.937058:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+30:10495:x1875966758534144:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 320us (678us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789061602.937066:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1789061603.066913:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.067088:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758534400 00000100:00100000:1.0:1789061603.067103:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758534400 00000100:00100000:1.0:1789061603.067183:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:1.0:1789061603.067196:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+30:10506:x1875966758534400:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1789061603.067232:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061603.067265:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9addd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a15e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.067375:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ade4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.067394:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ade4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.067408:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ade4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.067427:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9adeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.067434:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9adeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.067442:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9adeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.067844:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9adf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.067868:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9adf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.067877:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9adf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061603.067891:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789061603.068016:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ade4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068026:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ade4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068033:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ade4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068040:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061603.068046:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ade4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068056:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ade4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068071:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:1.0:1789061603.068075:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061603.068081:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ade4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068088:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ade4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068103:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9adeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068116:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9adeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068123:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9adeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068128:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061603.068130:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9adeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068136:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9adeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068143:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a6af68f00) 00010000:00010000:1.0:1789061603.068145:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061603.068148:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9adeb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068153:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9adeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068213:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9addd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a15e expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068229:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9adf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a15e expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.068237:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636400) 00010000:00010000:1.0:1789061603.068240:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061603.068248:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525e00, rc 0) 00000100:00100000:1.0:1789061603.068349:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+32:10506:x1875966758534400:12345-192.168.204.54@tcp:101:cat.0 Request processed in 1156us (1455us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789061603.068359:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:0.0:1789061603.069842:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779527680:0@lo:400:kworker.0 00000100:00100000:1.0:1789061603.069910:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779527424:0@lo:400:kworker.0 00000100:00100000:1.0:1789061603.069964:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061603.070029:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779527936:0@lo:400:kworker.0 00000100:00100000:1.0:1789061603.070054:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061603.070094:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789061603.070101:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779527296:0@lo:400:kworker.0 00000100:00100000:3.0:1789061603.070116:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779527552:0@lo:400:kworker.0 00000100:00100000:1.0:1789061603.070132:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061603.070148:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061603.070154:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779527808:0@lo:400:kworker.0 00000100:00100000:1.0:1789061603.070176:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061603.070205:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779527936 00000100:00100000:1.0:1789061603.070215:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779527936 00000100:00100000:2.0:1789061603.070230:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779527296 00000100:00100000:2.0:1789061603.070249:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779527296 00000100:00100000:2.0:1789061603.070278:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789061603.070278:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789061603.070286:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3311:x1875966779527296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061603.070286:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875966779527936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061603.070343:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3311:x1875966779527296:12345-0@lo:400:kworker.0 Request processed in 57us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061603.070343:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875966779527936:12345-0@lo:400:kworker.0 Request processed in 57us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061603.070351:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789061603.070366:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789061603.070425:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789061603.070473:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061603.070560:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:24dfd7ac-7455-4043-9449-a564380782df:3311:1875966779527296:0@lo:400:kworker.0 00000100:00100000:2.0:1789061603.070576:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779527936:0@lo:400:kworker.0 00000100:00100000:2.0:1789061603.070621:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779527680 00000100:00100000:2.0:1789061603.070625:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779527680 00000100:00100000:2.0:1789061603.070662:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789061603.070668:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875966779527680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061603.070714:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875966779527680:12345-0@lo:400:kworker.0 Request processed in 46us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061603.070720:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1789061603.070732:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061603.070750:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779527680:0@lo:400:kworker.0 00000100:00100000:3.0:1789061603.075670:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779527424 00000100:00100000:3.0:1789061603.075712:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779527424 00000100:00100000:3.0:1789061603.075812:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779527552 00000100:00100000:3.0:1789061603.075817:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779527552 00000100:00100000:3.0:1789061603.075854:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779527808 00000100:00100000:3.0:1789061603.075858:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779527808 00000100:00100000:3.0:1789061603.075882:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789061603.075895:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779527424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061603.076043:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779527424:12345-0@lo:400:kworker.0 Request processed in 150us (6078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061603.076051:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789061603.076072:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789061603.076079:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779527552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061603.076117:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779527552:12345-0@lo:400:kworker.0 Request processed in 38us (5967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061603.076124:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789061603.076136:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789061603.076142:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779527808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061603.076202:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779527808:12345-0@lo:400:kworker.0 Request processed in 60us (6024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061603.076209:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1789061603.076237:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061603.076286:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779527552:0@lo:400:kworker.0 00000100:00100000:3.0:1789061603.076335:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779527808:0@lo:400:kworker.0 00000100:00100000:3.0:1789061603.076348:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779527424:0@lo:400:kworker.0 00000100:00100000:3.0:1789061603.076686:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061603.076717:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758534656 00000100:00100000:3.0:1789061603.076723:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758534656 00000100:00100000:3.0:1789061603.076758:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1789061603.076765:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+32:10506:x1875966758534656:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:3.0:1789061603.077076:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+33:10506:x1875966758534656:12345-192.168.204.54@tcp:35:cat.0 Request processed in 308us (403us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789061603.077084:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:2.0:1789061603.094426:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061603.094626:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758534912 00000100:00100000:3.0:1789061603.094641:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758534912 00000100:00100000:3.0:1789061603.094740:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:3.0:1789061603.094754:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+33:10508:x1875966758534912:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:3.0:1789061603.094836:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789061603.094873:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9adf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a15e expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.094902:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9adc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a157 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.095311:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9ad90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a149 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.095326:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636400) 00010000:00010000:3.0:1789061603.095340:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061603.095371:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9ae00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.095389:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9ae00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.098409:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9ae00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.098501:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9ae07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.098518:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9ae07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.098527:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9ae07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.098910:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ae0e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.099181:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ae0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.099191:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ae0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789061603.101179:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1789061603.101200:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377342711616ns, next at 378342707106ns, rc = 0 00010000:00010000:3.0:1789061603.101301:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9ae15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.101321:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9ae15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.101336:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9ae15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.101346:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9ae15 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.101353:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9ae15 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.101361:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9ae15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102251:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789061603.102293:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ae0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102302:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ae0e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102310:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ae0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102316:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40031e00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061603.102341:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ae0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102350:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ae0e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102367:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636700) 00010000:00010000:3.0:1789061603.102370:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789061603.102376:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ae0e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102383:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9ae0e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102423:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9ae00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102430:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9ae00 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102546:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9ae00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102551:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061603.102554:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9ae00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102560:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9ae00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102568:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:3.0:1789061603.102571:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061603.102582:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9ae00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.102589:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9ae00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061603.102604:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003e753d2 reply state 00000000a0e6403d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9ae07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061603.102616:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061603.105315:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+32:10508:x1875966758534912:12345-192.168.204.54@tcp:36:rm.0 Request processed in 10545us (10885us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789061603.105331:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00010000:00010000:2.0:1789061603.110810:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9ae07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.110840:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9ae07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.110850:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9ae07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.110857:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061603.110885:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9ae07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.110894:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9ae07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.110915:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a43636300) 00010000:00010000:2.0:1789061603.110929:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061603.110936:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9ae07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.110943:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9ae07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.112445:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061603.112465:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9ae15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.112477:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061603.112483:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9ae15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.112522:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9ae15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.112568:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff971a43636700) 00010000:00010000:0.0:1789061603.112572:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789061603.112578:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9ae15 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.112585:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9ae15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.112705:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061603.112709:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061603.112711:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061603.177110:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.177285:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758535168 00000100:00100000:1.0:1789061603.177299:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758535168 00000100:00100000:1.0:1789061603.177390:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:1.0:1789061603.177402:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+31:10514:x1875966758535168:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1789061603.177455:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061603.177484:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9ae1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a165 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.177761:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ae23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.177782:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ae23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.177797:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ae23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.177814:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9ae2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.177821:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9ae2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.177829:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9ae2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789061603.180541:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789061603.180935:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ae31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.180962:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ae31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.180980:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ae31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.181064:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ae23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.181073:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ae23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.181082:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ae23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.181089:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061603.181095:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ae23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.181105:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ae23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.181121:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:1.0:1789061603.181125:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061603.181132:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ae23 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.181140:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9ae23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789061603.181159:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c74ec83d reply state 00000000e5a66818 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9ae2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061603.181172:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789061603.181222:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9ae1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a165 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.181254:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ae31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a165 expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.181263:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:1.0:1789061603.181266:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061603.181269:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525e00, rc 0) 00000100:00100000:1.0:1789061603.181396:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+34:10514:x1875966758535168:12345-192.168.204.54@tcp:101:bash.0 Request processed in 3995us (4302us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789061603.181407:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00010000:00010000:2.0:1789061603.188329:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9ae2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.188354:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9ae2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.188363:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9ae2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.188370:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061603.188377:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9ae2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.188386:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9ae2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.188410:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a6af68f00) 00010000:00010000:2.0:1789061603.188441:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061603.188449:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9ae2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.188456:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9ae2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061603.189931:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.190038:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758535296 00000100:00100000:1.0:1789061603.190052:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758535296 00000100:00100000:1.0:1789061603.190128:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:1.0:1789061603.190141:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758535296:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1789061603.190165:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061603.190191:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9ae3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a16c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061603.190230:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789061603.190261:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1789061603.190266:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061603.190279:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9ae3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a16c expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.190306:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9ae3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a16c expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.190344:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525600, rc 0) 00000100:00100000:1.0:1789061603.190530:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758535296:12345-192.168.204.54@tcp:101:bash.0 Request processed in 390us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061603.190538:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:1.0:1789061603.195478:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061603.195619:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758535424 00000100:00100000:2.0:1789061603.195633:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758535424 00000100:00100000:2.0:1789061603.195718:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:2.0:1789061603.195745:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+8:10514:x1875966758535424:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789061603.195771:0:8285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061603.195796:0:8285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a173 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.195843:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9ae3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a16c expref: 9 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.195855:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061603.195860:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061603.195867:0:8285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 9 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.195915:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9ae3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a16c expref: 9 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.195933:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9ae3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a16c expref: 9 pid: 6702 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061603.195968:0:8285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8285:1875966779528064:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061603.196103:0:8285:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26180 going to sleep for 11 seconds 00010000:00010000:1.0:1789061603.197843:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061603.201946:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061603.202141:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758535552 00000100:00100000:0.0:1789061603.202154:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758535552 00010000:00010000:0.0:1789061603.202207:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9ae3f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a16c expref: 10 pid: 6702 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061603.202270:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1789061603.202282:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c97450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+10:2356:x1875966758535552:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061603.202303:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061603.202333:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9ae3f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a16c expref: 10 pid: 6702 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.202349:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9ae3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a16c expref: 10 pid: 6702 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.202386:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061603.202392:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061603.202403:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 10 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.202451:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 10 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.202550:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 10 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061603.202569:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75865f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5836:1875966779528192:192.168.204.54@tcp:105: 00010000:00010000:2.0:1789061603.203716:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9ae3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a16c expref: 10 pid: 6702 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061603.203755:0:8285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8285:1875966779528064:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061603.203796:0:8285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 9 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.203812:0:8285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fc00, rc 0) 00000100:00100000:0.0:1789061603.203891:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f50240 going to sleep for 11 seconds 00000100:00100000:2.0:1789061603.208992:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+9:10514:x1875966758535424:12345-192.168.204.54@tcp:101:bash.0 Request processed in 13219us (13497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061603.209012:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1789061603.219435:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75865f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5836:1875966779528192:192.168.204.54@tcp:105: 00010000:00010000:0.0:1789061603.219477:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061603.219578:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c97450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758535552:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 17297us (17645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061603.219591:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1789061603.223230:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061603.223343:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758535808 00000100:00100000:3.0:1789061603.223357:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758535808 00000100:00100000:3.0:1789061603.223435:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1789061603.223449:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+33:10514:x1875966758535808:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1789061603.224432:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+34:10514:x1875966758535808:12345-192.168.204.54@tcp:35:bash.0 Request processed in 980us (1212us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789061603.224445:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1789061603.392277:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.392409:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758535936 00000100:00100000:1.0:1789061603.392423:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758535936 00000100:00100000:1.0:1789061603.392548:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:1.0:1789061603.392562:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+34:10530:x1875966758535936:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789061603.392595:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061603.392622:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a17a expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.392734:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9ae54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.392756:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9ae54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.392773:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9ae54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061603.392836:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789061603.392841:0:8391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789061603.392869:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9ae54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.392925:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a17a expref: 36 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.392949:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9ae54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a17a expref: 35 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.392959:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:1.0:1789061603.392962:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789061603.392968:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525a00, rc 0) 00000100:00100000:1.0:1789061603.393057:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+35:10530:x1875966758535936:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 498us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061603.393065:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:1.0:1789061603.400974:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061603.401170:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758536192 00000100:00100000:0.0:1789061603.401187:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758536192 00000100:00100000:0.0:1789061603.401270:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:0.0:1789061603.401284:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+35:10530:x1875966758536192:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789061603.401318:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061603.401348:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9ae5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a181 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.401537:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9ae62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.401558:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9ae62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.401593:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9ae62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061603.401608:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789061603.401797:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9ae5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a181 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.401820:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9ae62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a181 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.401831:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:0.0:1789061603.401834:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061603.401839:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596d200, rc 0) 00000100:00100000:0.0:1789061603.401932:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+37:10530:x1875966758536192:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 651us (975us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789061603.401940:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:0.0:1789061603.407027:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.407168:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758536448 00000100:00100000:1.0:1789061603.407182:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758536448 00000100:00100000:1.0:1789061603.407261:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:1.0:1789061603.407274:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+37:10530:x1875966758536448:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789061603.407318:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061603.407346:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a188 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.407475:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.407539:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.407574:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061603.407589:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789061603.407757:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a188 expref: 40 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.407780:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a188 expref: 39 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.407790:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:1.0:1789061603.407793:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789061603.407798:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525c00, rc 0) 00000100:00100000:1.0:1789061603.407874:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+39:10530:x1875966758536448:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 603us (864us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789061603.407881:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:1.0:1789061603.408649:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061603.409388:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758536576 00000100:00100000:3.0:1789061603.409403:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758536576 00000100:00100000:3.0:1789061603.409467:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1789061603.409477:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+39:2356:x1875966758536576:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061603.409529:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061603.409556:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9ae62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a181 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.409595:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:3.0:1789061603.409601:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061603.409675:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+38:2356:x1875966758536576:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 188us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061603.409685:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1789061603.416328:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.416526:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758536704 00000100:00100000:1.0:1789061603.416541:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758536704 00000100:00100000:1.0:1789061603.416622:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1789061603.416636:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758536704:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:1.0:1789061603.416708:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.416734:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 8 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.416769:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061603.416775:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061603.416780:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.416829:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 8 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.416847:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 8 pid: 8285 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061603.416865:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6702:1875966779528320:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061603.417281:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cbf7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789061603.422701:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061603.422860:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6702:1875966779528320:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061603.422906:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758536832 00010000:00010000:2.0:1789061603.422913:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061603.422918:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758536832 00002000:00100000:0.0:1789061603.422994:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff971a7d1e9180 x1875966758536832/t0(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:24/0 lens 504/0 e 0 to 0 dl 1789061614 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061603.423006:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a7d1e9180 with x1875966758536832 ext(0->8) 00010000:00010000:0.0:1789061603.423015:0:6707:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 9 pid: 8285 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.423034:0:6707:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 9 pid: 8285 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789061603.423064:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff971a7d1e9180 00000100:00100000:0.0:1789061603.423105:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1789061603.423117:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2355:x1875966758536832:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:0.0:1789061603.424212:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+11:2355:x1875966758536832:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 1088us (1517us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789061603.424223:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00002000:00100000:0.0:1789061603.424235:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff971a7d1e9180 x1875966758536832/t4294967302(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:24/0 lens 504/448 e 0 to 0 dl 1789061614 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061603.424247:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a7d1e9180 with x1875966758536832 ext(0->8) 00010000:00010000:0.0:1789061603.424256:0:6707:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 11 pid: 8285 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.424276:0:6707:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 11 pid: 8285 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789061603.424284:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff971a7d1e9180 00000100:00100000:3.0:1789061603.433055:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.433280:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758536960 00000100:00100000:1.0:1789061603.433294:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758536960 00010000:00010000:1.0:1789061603.433358:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 11 pid: 8285 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061603.433411:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:1.0:1789061603.433426:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+11:2356:x1875966758536960:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061603.433447:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789061603.433476:0:7648:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789061603.433480:0:7648:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789061602 00002000:00010000:1.0:1789061603.433555:0:7648:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789061602 00002000:00010000:1.0:1789061603.433557:0:7648:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789061602 00010000:00010000:1.0:1789061603.433566:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 11 pid: 8285 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.433584:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 11 pid: 8285 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.433630:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ae46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a173 expref: 11 pid: 8285 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.433652:0:7648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061603.433658:0:7648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061603.433675:0:7648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.433687:0:7648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.433904:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061603.433996:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+10:2356:x1875966758536960:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 572us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061603.434006:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00010000:00010000:2.0:1789061603.434531:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.434546:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.434613:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.434625:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.434635:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.434643:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524200 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061603.434649:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.434660:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.434691:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.434700:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000044e40be/0x427fa11dc4a9ae85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061603.434900:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2356:x1875966758536704:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 18265us (18586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061603.434910:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1789061603.447076:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.447868:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758537216 00000100:00100000:1.0:1789061603.447884:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758537216 00000100:00100000:1.0:1789061603.448041:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:1.0:1789061603.448056:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a65027450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+38:10530:x1875966758537216:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:1.0:1789061603.448177:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a188 expref: 38 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789061603.448556:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789061603.448619:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789061603.449082:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789061603.449150:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.449171:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ae31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a165 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.449182:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.449230:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ae31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a165 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.449249:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ae31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a165 expref: 42 pid: 5851 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061603.449267:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1e9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1875966779528448:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061603.449383:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0900 going to sleep for 11 seconds 00000100:00100000:1.0:1789061603.458143:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1e9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1875966779528448:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789061603.458183:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061603.461064:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061603.461538:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758537344 00000100:00100000:3.0:1789061603.461737:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758537344 00010000:00010000:3.0:1789061603.461803:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ae31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a165 expref: 43 pid: 5851 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061603.462067:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:2.0:1789061603.462082:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+43:2355:x1875966758537344:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061603.462102:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061603.462111:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ae31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a165 expref: 43 pid: 5851 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.462127:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ae31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a165 expref: 43 pid: 5851 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.462155:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9ae31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a165 expref: 43 pid: 5851 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.462178:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:2.0:1789061603.462185:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.462197:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.462206:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.462306:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061603.462386:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+42:2355:x1875966758537344:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 307us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061603.462394:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00010000:00010000:1.0:1789061603.462452:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.462481:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789061603.462814:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789061603.463264:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1789061603.463421:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1e9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779528576:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789061603.463597:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061603.463688:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0000 going to sleep for 11 seconds 00000100:00100000:2.0:1789061603.463735:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779528576 00000100:00100000:2.0:1789061603.463751:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779528576 00000100:00100000:2.0:1789061603.463800:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789061603.463811:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5855:x1875966779528576:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789061603.463961:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5855:x1875966779528576:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 152us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061603.463969:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789061603.464238:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1e9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779528576:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789061603.466069:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789061603.466204:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1e9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779528704:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789061603.466285:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061603.466392:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789061603.466450:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779528704 00000100:00100000:2.0:1789061603.466461:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779528704 00000100:00100000:2.0:1789061603.466689:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789061603.466702:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5855:x1875966779528704:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789061603.466959:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5855:x1875966779528704:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 259us (673us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789061603.466968:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789061603.467126:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1e9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779528704:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789061603.467195:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1789061603.467241:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.467253:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.467261:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.467268:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061603.467273:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.467300:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.467321:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:1.0:1789061603.467324:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789061603.467330:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.467336:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9ae8c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789061603.467587:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789061603.467727:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1789061603.467742:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377709253353ns, next at 378709250912ns, rc = 0 00000001:00080000:1.0:1789061603.467749:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1789061603.467786:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:1.0:1789061603.467789:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789061603.467797:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a188 expref: 46 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061603.467931:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a65027450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+45:10530:x1875966758537216:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 19879us (20873us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1789061603.467939:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000020:00080000:1.0:1789061603.467944:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789061603.475693:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061603.480218:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758537472 00000100:00100000:0.0:1789061603.480243:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758537472 00000100:00100000:0.0:1789061603.480420:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:0.0:1789061603.480435:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+45:10530:x1875966758537472:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789061603.480478:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061603.480547:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9ae93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a18f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.480660:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9ae93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a18f expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.480692:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9ae93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a18f expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.480728:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:0.0:1789061603.480732:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789061603.480737:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596da00, rc 0) 00000100:00100000:0.0:1789061603.480843:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+46:10530:x1875966758537472:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 411us (5164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061603.480852:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:3.0:1789061603.484420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061603.484576:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758537728 00000100:00100000:2.0:1789061603.484590:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758537728 00000100:00100000:2.0:1789061603.484958:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1789061603.484974:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+46:10530:x1875966758537728:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789061603.486296:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+47:10530:x1875966758537728:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 1317us (1881us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1789061603.486363:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1789061603.582584:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061603.582622:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779528832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061603.582755:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061603.583114:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779528832 00000100:00100000:1.0:1789061603.583126:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779528832 00000100:00100000:1.0:1789061603.583196:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789061603.583209:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779528832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061603.583287:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061603.583362:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779528832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061603.583370:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789061603.583639:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779528832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061603.611786:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.612212:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758537856 00000100:00100000:1.0:1789061603.612228:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758537856 00000100:00100000:1.0:1789061603.612313:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:1.0:1789061603.612326:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+47:10540:x1875966758537856:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1789061603.612446:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.612470:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.612522:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.612541:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aea1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.612548:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.612555:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.612677:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aea8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.612685:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.612710:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789061603.613045:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613065:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613082:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613089:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613096:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525c00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061603.613101:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613110:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613126:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:1.0:1789061603.613130:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061603.613135:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613142:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9ae9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613158:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613172:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aea1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613178:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613183:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061603.613187:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613193:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aea1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613201:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a6af68a00) 00010000:00010000:1.0:1789061603.613204:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061603.613207:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aea1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613213:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aea1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613230:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613237:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aea8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613243:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613248:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525e00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061603.613257:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613264:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aea8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613272:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:1.0:1789061603.613275:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061603.613278:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aea8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.613285:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aea8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061603.613395:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+47:10540:x1875966758537856:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1069us (3338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061603.613404:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:3.0:1789061603.668653:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.669171:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758538112 00000100:00100000:1.0:1789061603.669187:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758538112 00000100:00100000:1.0:1789061603.669268:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:1.0:1789061603.669282:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+47:10543:x1875966758538112:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789061603.669314:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061603.669346:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aeaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a196 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.669448:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aeb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.669466:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aeb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.669545:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aeb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.669562:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aebd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.669569:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.669575:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.669750:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9aec4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.669759:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9aec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.669766:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9aec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061603.669778:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789061603.669941:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aeb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.669950:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aeb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.669958:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aeb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.669965:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061603.669977:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aeb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.669987:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aeb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.670002:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:1.0:1789061603.670005:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061603.670011:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aeb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.670017:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9aeb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.670033:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.670040:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aebd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.670047:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.670053:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525c00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061603.670057:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.670063:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aebd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.670072:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a6af68a00) 00010000:00010000:1.0:1789061603.670074:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061603.670085:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aebd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.670091:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aebd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.670149:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aeaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a196 expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.670167:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9aec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a196 expref: 49 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.670174:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:1.0:1789061603.670177:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061603.670179:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524200, rc 0) 00000100:00100000:1.0:1789061603.670268:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+49:10543:x1875966758538112:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 989us (1629us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789061603.670277:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:0.0:1789061603.677239:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.679172:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758538240 00000100:00100000:1.0:1789061603.679192:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758538240 00000100:00100000:1.0:1789061603.679272:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:1.0:1789061603.679285:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+49:10543:x1875966758538240:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1789061603.679379:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.679403:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.679419:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.679479:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.679508:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aed2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.679517:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.679524:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525e00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061603.679529:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.679538:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aed2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.679553:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:1.0:1789061603.679558:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789061603.679564:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aed2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.679571:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061603.679856:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+49:10543:x1875966758538240:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 570us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061603.679866:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00000001:00080000:0.0:1789061603.681448:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1789061603.681475:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:0.0:1789061603.681516:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1789061603.686419:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061603.687183:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758538496 00000100:00100000:3.0:1789061603.687197:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758538496 00000100:00100000:3.0:1789061603.687279:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1789061603.687292:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+49:10543:x1875966758538496:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789061603.687684:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+50:10543:x1875966758538496:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 394us (1278us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789061603.687693:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1789061603.788076:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.788339:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758538752 00000100:00100000:1.0:1789061603.788354:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758538752 00000100:00100000:1.0:1789061603.788453:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:1.0:1789061603.788465:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+50:10553:x1875966758538752:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1789061603.788550:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061603.788554:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789061603.788596:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9ae54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a17a expref: 50 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.788623:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:1.0:1789061603.788629:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061603.788669:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aed9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a19d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.788801:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aee0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.788819:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.788843:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061603.788858:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789061603.789031:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9aed9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a19d expref: 52 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.789817:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a19d expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.789841:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:1.0:1789061603.789864:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061603.789869:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525c00, rc 0) 00000100:00100000:1.0:1789061603.790011:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+51:10553:x1875966758538752:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1547us (1950us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789061603.790021:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:0.0:1789061603.799026:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061603.799084:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.799124:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758538880 00000100:00100000:1.0:1789061603.799138:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758538880 00000100:00100000:1.0:1789061603.799235:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1789061603.799249:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75867800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+51:2355:x1875966758538880:12345-192.168.204.54@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789061603.799255:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758539136 00000100:00100000:3.0:1789061603.799262:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758539136 00010000:00010000:1.0:1789061603.799269:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061603.799306:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9aee0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a19d expref: 52 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061603.799311:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:3.0:1789061603.799325:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+51:10553:x1875966758539136:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:1.0:1789061603.799335:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:1.0:1789061603.799343:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061603.799419:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75867800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+51:2355:x1875966758538880:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 174us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061603.799427:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00010000:00010000:3.0:1789061603.799428:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061603.799446:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9aec4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a196 expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.799459:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:3.0:1789061603.799462:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061603.800466:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9aeee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.800517:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9aeee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.800531:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9aeee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789061603.800616:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1789061603.800650:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008529dde0 reply state 000000007818fa82 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9aeee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061603.800673:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061603.801179:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+52:10553:x1875966758539136:12345-192.168.204.54@tcp:36:bash.0 Request processed in 1853us (2089us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789061603.801190:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00000020:00080000:3.0:1789061603.801197:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789061603.805109:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9aeee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.805135:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9aeee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.805145:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9aeee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.805172:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061603.805178:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9aeee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.805187:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9aeee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.805210:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:2.0:1789061603.805213:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061603.805221:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9aeee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.805228:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9aeee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061603.807911:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061603.808170:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758539264 00000100:00100000:0.0:1789061603.808185:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758539264 00000100:00100000:0.0:1789061603.808269:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:0.0:1789061603.808299:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+51:10553:x1875966758539264:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789061603.808333:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061603.808363:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9aef5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.808721:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9aefc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.808741:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9aefc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.808754:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9aefc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061603.809264:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789061603.809271:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061603.809302:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9aefc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.809345:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9aef5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1a4 expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.809371:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9aefc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1a4 expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.809381:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:0.0:1789061603.809385:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061603.809389:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596de00, rc 0) 00000100:00100000:0.0:1789061603.809476:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+52:10553:x1875966758539264:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1179us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061603.809703:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:0.0:1789061603.813069:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061603.813249:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758539520 00000100:00100000:3.0:1789061603.813264:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758539520 00000100:00100000:3.0:1789061603.813385:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:3.0:1789061603.813400:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+52:10553:x1875966758539520:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1789061603.814243:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+53:10553:x1875966758539520:12345-192.168.204.54@tcp:35:bash.0 Request processed in 841us (1185us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789061603.814274:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1789061603.936137:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061603.937554:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758539648 00000100:00100000:2.0:1789061603.937572:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758539648 00000100:00100000:2.0:1789061603.937677:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:2.0:1789061603.937690:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+53:10559:x1875966758539648:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061603.937726:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061603.937753:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9af03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1ab expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.937876:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9af0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.937901:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9af0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.937916:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9af0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061603.937999:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789061603.938004:0:8391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061603.938026:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9af0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.938055:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9af03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ab expref: 55 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.938077:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9af0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ab expref: 54 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.938085:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:2.0:1789061603.938088:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061603.938093:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e400, rc 0) 00000100:00100000:2.0:1789061603.938184:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+54:10559:x1875966758539648:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 496us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061603.938192:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:1.0:1789061603.947725:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061603.947980:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758539776 00000100:00100000:2.0:1789061603.947996:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758539776 00000100:00100000:2.0:1789061603.948077:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:2.0:1789061603.948091:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+54:10559:x1875966758539776:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061603.948121:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061603.948156:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9af11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.948244:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.948462:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.948480:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.948747:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.948757:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.948765:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.948893:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9af26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.948902:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9af26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.948910:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9af26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061603.948957:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789061603.948963:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061603.949747:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9af26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949775:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9af26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949815:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949823:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949831:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949844:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061603.949849:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949858:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949877:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:2.0:1789061603.949880:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061603.949887:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949893:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949912:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949919:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949924:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949937:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061603.949940:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949947:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949956:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a613b5d00) 00010000:00010000:2.0:1789061603.949959:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061603.949962:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.949967:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.950028:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9af11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b2 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.950045:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9af26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b2 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.950054:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:2.0:1789061603.950056:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061603.950059:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fc00, rc 0) 00000100:00100000:2.0:1789061603.950161:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+55:10559:x1875966758539776:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 2071us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061603.950172:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:1.0:1789061603.956869:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061603.957149:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758540032 00000100:00100000:3.0:1789061603.957165:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758540032 00000100:00100000:3.0:1789061603.957244:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:3.0:1789061603.957258:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+55:10559:x1875966758540032:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061603.957295:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061603.957322:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9af2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1b9 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.957477:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.957528:0:8391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9aefc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1a4 expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.957536:0:8391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9af26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b2 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.957545:0:8391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.957596:0:8391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9af26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b2 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.957613:0:8391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9af26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b2 expref: 56 pid: 5851 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061603.957630:0:8391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8391:1875966779528960:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061603.958037:0:8391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9aefc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1a4 expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.958048:0:8391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9aefc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1a4 expref: 56 pid: 5852 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061603.958058:0:8391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8391:1875966779529088:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061603.958086:0:8391:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a79e9e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061603.961765:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:3.0:1789061603.961955:0:8391:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.54@tcp) returned -22 from blocking AST (req@00000000ecfb961d x1875966779528960) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9af26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b2 expref: 56 pid: 5851 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.961992:0:8391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9af26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b2 expref: 56 pid: 5851 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.962023:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9af26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b2 expref: 56 pid: 5851 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061603.962044:0:8391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8391:1875966779528960:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061603.962060:0:8391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8391:1875966779529088:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061603.962087:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:3.0:1789061603.962094:0:8391:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.962104:0:8391:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.962114:0:8391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061603.962230:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758540160 00000100:00100000:2.0:1789061603.962246:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758540160 00000100:00100000:2.0:1789061603.962339:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1789061603.962352:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+56:2356:x1875966758540160:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061603.962372:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061603.962376:0:5835:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 427fa11dc4a9af26) 00010000:00010000:2.0:1789061603.962378:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061603.962449:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+56:2356:x1875966758540160:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 100us (701us total) trans 0 rc 116/116 00000100:00100000:2.0:1789061603.962458:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1789061603.965779:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061603.966072:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758540288 00000100:00100000:1.0:1789061603.966085:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758540288 00010000:00010000:1.0:1789061603.966144:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9aefc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1a4 expref: 56 pid: 5852 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061603.966221:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:1.0:1789061603.966233:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+56:2355:x1875966758540288:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061603.966253:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061603.966262:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9aefc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1a4 expref: 56 pid: 5852 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.966290:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9aefc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1a4 expref: 56 pid: 5852 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.966318:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9aefc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1a4 expref: 56 pid: 5852 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.966339:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:1.0:1789061603.966347:0:7648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.966357:0:7648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.966365:0:7648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061603.966407:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061603.966531:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+55:2355:x1875966758540288:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 253us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061603.966540:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00010000:00010000:3.0:1789061603.966627:0:8391:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.966636:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061603.966668:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789061603.966866:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9af2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b9 expref: 56 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.966887:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b9 expref: 55 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.966896:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:3.0:1789061603.966898:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789061603.966901:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40031400, rc 0) 00000100:00100000:3.0:1789061603.966945:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+55:10559:x1875966758540032:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 9691us (10089us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789061603.966953:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:1.0:1789061603.972114:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061603.972326:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758540544 00000100:00100000:2.0:1789061603.972340:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758540544 00000100:00100000:2.0:1789061603.972427:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1789061603.972440:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+55:10559:x1875966758540544:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:2.0:1789061603.972462:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061603.972545:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9ae93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a18f expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061603.972569:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:2.0:1789061603.972577:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061603.972647:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+54:10559:x1875966758540544:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 209us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061603.972667:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1789061603.976154:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061603.976274:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758540672 00000100:00100000:0.0:1789061603.976288:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758540672 00000100:00100000:0.0:1789061603.976371:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:0.0:1789061603.976383:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+54:10559:x1875966758540672:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:0.0:1789061603.976586:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9af42 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.976609:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9af42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061603.976625:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9af42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789061603.977283:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789061603.977466:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+54:10559:x1875966758540672:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 1082us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061603.977478:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:1.0:1789061603.981224:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061603.981393:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758540800 00000100:00100000:3.0:1789061603.981408:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758540800 00000100:00100000:3.0:1789061603.981719:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:3.0:1789061603.981734:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+54:10559:x1875966758540800:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061603.981763:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061603.981790:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9af49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1c0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.981897:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9af42 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.981909:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9af49 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1c0 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.981933:0:5853:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9af42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.981949:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9af49 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1c0 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.981966:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:3.0:1789061603.981982:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061603.981986:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9af49 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1c0 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061603.981995:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40031e00, rc 0) 00000100:00100000:3.0:1789061603.982078:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+55:10559:x1875966758540800:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 348us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061603.982085:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 111 00010000:00010000:2.0:1789061604.227131:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789061604.992217:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061604.992230:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789061604.992275:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789061604.992286:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789061604.992481:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a5cf41180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1875966779529216:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789061604.996305:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061605.002827:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a5cf41180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1875966779529216:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789061605.011122:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061605.011247:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758540928 00000100:00100000:3.0:1789061605.011264:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758540928 00000100:00100000:3.0:1789061605.011379:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:3.0:1789061605.011393:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+55:10560:x1875966758540928:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789061605.011439:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789061605.011668:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+55:10560:x1875966758540928:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 277us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061605.011677:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00080000:0.0:1789061605.016156:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061605.029615:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061605.029921:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758541056 00000100:00100000:2.0:1789061605.029935:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758541056 00000100:00100000:2.0:1789061605.030026:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:2.0:1789061605.030058:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+55:10560:x1875966758541056:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789061605.030162:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af50 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.030183:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.030201:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031050:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031077:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031091:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031138:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031147:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031153:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061605.031203:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789061605.031208:0:8391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061605.031224:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031256:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031262:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af50 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031270:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031275:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061605.031279:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031287:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af50 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031310:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee800) 00010000:00010000:2.0:1789061605.031314:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061605.031320:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031327:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9af50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031343:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031349:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af57 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031353:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031364:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061605.031367:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031372:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af57 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031381:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff971a613b5d00) 00010000:00010000:2.0:1789061605.031384:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061605.031386:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af57 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031392:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9af57 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031408:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031414:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031419:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031423:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fe00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061605.031426:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031431:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031449:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:2.0:1789061605.031451:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061605.031455:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.031461:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061605.031608:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+55:10560:x1875966758541056:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 1545us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061605.031621:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:3.0:1789061605.036119:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061605.036225:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758541312 00000100:00100000:2.0:1789061605.036238:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758541312 00000100:00100000:2.0:1789061605.036308:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:2.0:1789061605.036319:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+55:10560:x1875966758541312:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061605.036349:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061605.036375:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9af65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.036552:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.036570:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.036584:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061605.036597:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789061605.036762:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.036772:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.036779:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.036785:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fe00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061605.036790:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.036800:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.036814:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:2.0:1789061605.036817:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789061605.036822:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.036829:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.036873:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9af65 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1c7 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.036883:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee800) 00010000:00010000:2.0:1789061605.036886:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061605.036890:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9af65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1c7 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.036909:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63ee00, rc 0) 00000100:00100000:2.0:1789061605.036983:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+56:10560:x1875966758541312:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 665us (878us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1789061605.036991:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:1.0:1789061605.042077:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061605.042754:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758541440 00000100:00100000:3.0:1789061605.042769:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758541440 00000100:00100000:3.0:1789061605.042854:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:3.0:1789061605.042868:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+56:10560:x1875966758541440:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789061605.042922:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789061605.043124:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+56:10560:x1875966758541440:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 258us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061605.043133:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:1.0:1789061605.060610:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061605.061079:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758541696 00000100:00100000:2.0:1789061605.061095:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758541696 00000100:00100000:2.0:1789061605.061369:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:2.0:1789061605.061384:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+56:10560:x1875966758541696:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061605.061414:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061605.061419:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789061605.061460:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9af0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ab expref: 56 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.061668:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:2.0:1789061605.061675:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061605.061704:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9af7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1ce expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789061605.062285:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789061605.063408:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.063439:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.063453:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.064149:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9af7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ce expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.064178:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ce expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.064194:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff971a613b5d00) 00010000:00010000:2.0:1789061605.064198:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061605.064202:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fe00, rc 0) 00000100:00100000:2.0:1789061605.064301:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+57:10560:x1875966758541696:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2921us (3708us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789061605.064312:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:1.0:1789061605.069722:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061605.069856:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758541952 00000100:00100000:3.0:1789061605.069871:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758541952 00000100:00100000:3.0:1789061605.069956:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:3.0:1789061605.069969:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+57:10560:x1875966758541952:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789061605.070049:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061605.070089:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9af81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ce expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070115:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff971a613b5d00) 00010000:00010000:3.0:1789061605.070130:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061605.070160:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9af8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070177:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9af8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070215:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9af8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070233:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9af96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x28bc4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070241:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9af96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x28bc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070247:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9af96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x28bc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070337:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9af8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070345:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9af8f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070353:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9af8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070361:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030c00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061605.070366:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9af8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070376:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9af8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070384:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:3.0:1789061605.070387:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061605.070392:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9af8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070408:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9af8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070422:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9af96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x28bc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070429:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9af96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x28bc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070435:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9af96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x28bc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070440:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061605.070444:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9af96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x28bc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070450:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9af96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x28bc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070458:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x28bc4b (ffff971a43636200) 00010000:00010000:3.0:1789061605.070461:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061605.070464:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9af96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x28bc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.070469:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9af96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x28bc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061605.070613:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+56:10560:x1875966758541952:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 645us (907us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789061605.070623:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:1.0:1789061605.074280:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061605.082327:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758542080 00000100:00100000:0.0:1789061605.082350:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758542080 00000100:00100000:0.0:1789061605.082464:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:0.0:1789061605.082478:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+56:10560:x1875966758542080:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061605.083236:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061605.083276:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9af9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1d5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.083330:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9afa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.083348:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9afa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.083365:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9afa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.083653:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9af9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1d5 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.083680:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9afa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1d5 expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.083919:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:1.0:1789061605.083923:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789061605.083929:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525c00, rc 0) 00000100:00100000:1.0:1789061605.086388:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+57:10560:x1875966758542080:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 3891us (12101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061605.086429:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:1.0:1789061605.097169:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061605.097293:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758542336 00000100:00100000:2.0:1789061605.097308:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758542336 00000100:00100000:2.0:1789061605.097388:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:2.0:1789061605.097401:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+57:10560:x1875966758542336:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789061605.097556:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.097581:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.097596:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789061605.097944:0:8391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1789061605.099077:0:8391:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379340587561ns, next at 380340578583ns, rc = 0 00000004:00010000:2.0:1789061605.099259:0:8391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b40a4ef reply state 0000000028fba8ea transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061605.099275:0:8391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061605.100854:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+59:10560:x1875966758542336:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 3442us (3688us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789061605.100868:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:1.0:1789061605.106690:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:2.0:1789061605.106834:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.106851:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.106859:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.106866:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ee00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061605.106872:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.106881:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.106901:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:2.0:1789061605.106903:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789061605.106909:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.106915:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061605.107228:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758542464 00000100:00100000:3.0:1789061605.107243:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758542464 00000100:00100000:3.0:1789061605.107352:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:3.0:1789061605.107365:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+58:10560:x1875966758542464:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061605.107398:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061605.107431:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9afb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.107554:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9afb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1dc expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.107572:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9afb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1dc expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.107597:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:3.0:1789061605.107599:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061605.107603:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40030600, rc 0) 00000100:00100000:3.0:1789061605.107713:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+59:10560:x1875966758542464:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 350us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061605.107720:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:1.0:1789061605.111754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061605.111869:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758542592 00000100:00100000:2.0:1789061605.111898:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758542592 00000100:00100000:2.0:1789061605.112115:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1789061605.112129:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758542592:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789061605.112727:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2356:x1875966758542592:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 599us (1240us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789061605.112736:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1789061605.115566:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061605.115803:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758542848 00000100:00100000:3.0:1789061605.115820:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758542848 00000100:00100000:3.0:1789061605.115897:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:3.0:1789061605.115912:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+59:10560:x1875966758542848:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789061605.116353:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+60:10560:x1875966758542848:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 442us (805us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789061605.116362:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:1.0:1789061605.119643:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061605.119872:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758543104 00000100:00100000:3.0:1789061605.119889:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758543104 00000100:00100000:3.0:1789061605.119975:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:3.0:1789061605.119987:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+60:10560:x1875966758543104:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789061605.120305:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+60:10560:x1875966758543104:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 318us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061605.120312:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00080000:0.0:1789061605.120935:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061605.124197:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061605.124320:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758543232 00000100:00100000:1.0:1789061605.124335:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758543232 00000100:00100000:1.0:1789061605.124615:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:1.0:1789061605.124629:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+60:10560:x1875966758543232:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061605.124666:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061605.124704:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9afb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1e3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.124797:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9afc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.124815:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9afc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.124830:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9afc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061605.124878:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789061605.124903:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9afc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.124953:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9afb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1e3 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.125000:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9afc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1e3 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.125009:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:1.0:1789061605.125013:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789061605.125017:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524e00, rc 0) 00000100:00100000:1.0:1789061605.125147:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+61:10560:x1875966758543232:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 521us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061605.125155:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:2.0:1789061605.128828:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061605.128919:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758543360 00000100:00100000:1.0:1789061605.128941:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758543360 00000100:00100000:1.0:1789061605.129130:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:1.0:1789061605.129142:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2356:x1875966758543360:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061605.129168:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061605.129195:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004adddd4b/0x427fa11dc4a9afc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1ea expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061605.129230:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2e9e3, blocks: 0x1 00010000:00010000:1.0:1789061605.129263:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=379s v=(0 0) 00010000:00010000:1.0:1789061605.129269:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061605.129282:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004adddd4b/0x427fa11dc4a9afc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ea expref: 10 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.129307:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004adddd4b/0x427fa11dc4a9afc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ea expref: 10 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.129351:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525e00, rc 0) 00000100:00100000:1.0:1789061605.129446:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+10:2356:x1875966758543360:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 307us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061605.129454:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:2.0:1789061605.133705:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061605.133929:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758543616 00000100:00100000:3.0:1789061605.133946:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758543616 00000100:00100000:3.0:1789061605.134040:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:3.0:1789061605.134053:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+61:10560:x1875966758543616:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789061605.134208:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+61:10560:x1875966758543616:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 157us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061605.134216:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:3.0:1789061605.138045:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061605.138202:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758543744 00000100:00100000:2.0:1789061605.138217:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758543744 00000100:00100000:2.0:1789061605.138298:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:2.0:1789061605.138312:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+10:10560:x1875966758543744:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061605.138339:0:8285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061605.138366:0:8285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9afce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1f1 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.138424:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004adddd4b/0x427fa11dc4a9afc7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ea expref: 11 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.138435:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061605.138442:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061605.138449:0:8285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9afce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f1 expref: 11 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.138523:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004adddd4b/0x427fa11dc4a9afc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ea expref: 11 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.138560:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004adddd4b/0x427fa11dc4a9afc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ea expref: 11 pid: 6701 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061605.138579:0:8285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75867800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8285:1875966779529344:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061605.138725:0:8285:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061605.143121:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061605.143229:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758543872 00000100:00100000:1.0:1789061605.143243:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758543872 00010000:00010000:1.0:1789061605.143299:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004adddd4b/0x427fa11dc4a9afc7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ea expref: 12 pid: 6701 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061605.143355:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:1.0:1789061605.143367:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+12:2355:x1875966758543872:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061605.143388:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061605.143434:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004adddd4b/0x427fa11dc4a9afc7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ea expref: 12 pid: 6701 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.143462:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004adddd4b/0x427fa11dc4a9afc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ea expref: 12 pid: 6701 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.143552:0:7648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061605.143557:0:7648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061605.143570:0:7648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9afce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f1 expref: 12 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.143583:0:7648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9afce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f1 expref: 12 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.143731:0:7648:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9afce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f1 expref: 12 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061605.143775:0:7648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7648:1875966779529472:192.168.204.54@tcp:105: 00000100:00100000:1.0:1789061605.143886:0:7648:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4177ccc0 going to sleep for 11 seconds 00010000:00010000:3.0:1789061605.144207:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004adddd4b/0x427fa11dc4a9afc7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ea expref: 12 pid: 6701 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061605.144226:0:8285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75867800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8285:1875966779529344:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061605.144258:0:8285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9afce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f1 expref: 11 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.144270:0:8285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fc00, rc 0) 00000100:00100000:3.0:1789061605.144310:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+11:10560:x1875966758543744:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 6001us (6284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061605.144332:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:2.0:1789061605.151243:0:7648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7648:1875966779529472:192.168.204.54@tcp:105: 00010000:00010000:2.0:1789061605.151296:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061605.151391:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+10:2355:x1875966758543872:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 8025us (8283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061605.151404:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:2.0:1789061605.159271:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061605.159650:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758544000 00000100:00100000:3.0:1789061605.159666:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758544000 00002000:00100000:3.0:1789061605.159749:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff971a75cb3100 x1875966758544000/t0(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:26/0 lens 504/0 e 0 to 0 dl 1789061616 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789061605.159762:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a75cb3100 with x1875966758544000 ext(0->12) 00002000:00010000:3.0:1789061605.159769:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971a75cb3100 00000100:00100000:3.0:1789061605.159811:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1789061605.159823:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+10:2355:x1875966758544000:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789061605.161780:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+12:2355:x1875966758544000:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 1945us (2510us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789061605.161796:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00002000:00100000:3.0:1789061605.161811:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff971a75cb3100 x1875966758544000/t4294967308(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:26/0 lens 504/448 e 0 to 0 dl 1789061616 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789061605.161823:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a75cb3100 with x1875966758544000 ext(0->12) 00002000:00010000:3.0:1789061605.161831:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971a75cb3100 00000100:00100000:1.0:1789061605.165036:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061605.165154:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758544128 00000100:00100000:3.0:1789061605.165169:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758544128 00000100:00100000:3.0:1789061605.165256:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:3.0:1789061605.165271:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+61:10560:x1875966758544128:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789061605.231186:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967378 is committed 00000001:00080000:3.0:1789061605.231231:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000004:00080000:3.0:1789061605.231243:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789061605.231268:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff971a7cbf7780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789061605.231294:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a75b65f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff971a7cbf7840 00000020:00080000:3.0:1789061605.231298:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a75b65400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff971a75948000 00000020:00080000:3.0:1789061605.231339:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1789061605.231347:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1789061605.231351:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:3.0:1789061605.231377:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1789061605.231394:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789061605.231413:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff971a4349b3c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789061605.231416:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a4f7b4300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff971a4349ba80 00000020:00080000:3.0:1789061605.231419:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a4f7b4e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff971a60309c00 00000020:00080000:3.0:1789061605.232440:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:0.0:1789061605.232856:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779529600:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789061605.232972:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061605.233175:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779529600 00000100:00100000:1.0:1789061605.233186:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779529600 00000100:00100000:1.0:1789061605.233272:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789061605.233285:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779529600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789061605.233320:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1789061605.233367:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa2e9e2, atime: 0x6aa2e9e2, ctime: 0x6aa2e9e2, blocks: 0xb 00010000:00010000:1.0:1789061605.233378:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9afd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.233400:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=379s v=(0 0) 00010000:00010000:1.0:1789061605.233406:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061605.233414:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9afd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.233435:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9afd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.233448:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9afd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.233483:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9afd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.233533:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789061605.234380:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779529600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1094us (1404us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789061605.234392:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000020:00080000:3.0:1789061605.234598:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1789061605.234621:0:8477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061605.234642:0:8477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9afd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.234656:0:8477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524c00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061605.234661:0:8477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9afd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.234672:0:8477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9afd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789061605.234791:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061605.234840:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789061605.234847:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1789061605.234874:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff971a5cf41c00, transno 4294967301 00000004:00080000:0.0:1789061605.234886:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1789061605.234909:0:3313:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff971a75867800 x1875966779529600/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789061621 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789061605.234923:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff971a75867800/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789061605.234929:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779529600:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789061605.235062:0:8477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9afd5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.235087:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dab5a4f8/0x427fa11dc4a9afd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.235114:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061605.235116:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061605.235118:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061605.235257:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+15:10560:x1875966758544128:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 69987us (70237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061605.235267:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:3.0:1789061605.237910:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779529728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789061605.238019:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061605.238092:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061605.238100:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779529856:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789061605.238143:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061605.239118:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779529728 00000100:00100000:3.0:1789061605.239135:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779529728 00000100:00100000:3.0:1789061605.239209:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779529856 00000100:00100000:3.0:1789061605.239212:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779529856 00000100:00100000:3.0:1789061605.239239:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789061605.239251:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1875966779529728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789061605.239293:0:8285:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1789061605.239330:0:8285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.239358:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ad97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a150 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.239387:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1789061605.239392:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061605.239397:0:8285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.239441:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ad97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a150 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.239459:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ad97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a150 expref: 11 pid: 6699 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061605.239477:0:8285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8285:1875966779529984:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061605.239599:0:8285:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789061605.239624:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789061605.239646:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1875966779529856:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789061605.239828:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789061605.240001:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061605.243301:0:8285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8285:1875966779529984:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789061605.243341:0:8285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789061605.244167:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789061605.244176:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789061604 00002000:00010000:3.0:1789061605.244180:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789061605.244182:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789061603 -> 1789061604 00002000:00010000:3.0:1789061605.244185:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789061605.244280:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3310:x1875966779529856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4645us (6133us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789061605.244294:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789061605.244337:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758544256 00000100:00100000:3.0:1789061605.244371:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758544256 00000100:00100000:3.0:1789061605.244416:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:3.0:1789061605.244426:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+12:2355:x1875966758544256:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1789061605.246408:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9719477df480/2, rc 0, transno 4294967309 00000100:00100000:3.0:1789061605.246427:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779529856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789061605.247870:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:1.0:1789061605.248878:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061605.249509:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758544384 00000100:00100000:3.0:1789061605.249785:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758544384 00010000:00010000:3.0:1789061605.249847:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ad97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a150 expref: 13 pid: 6699 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061605.249892:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:3.0:1789061605.249906:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+13:2356:x1875966758544384:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061605.249925:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061605.249932:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ad97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a150 expref: 13 pid: 6699 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.250212:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ad97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a150 expref: 13 pid: 6699 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.250244:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ad97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a150 expref: 13 pid: 6699 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.250269:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061605.250274:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061605.250283:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.250317:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.250357:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061605.250441:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+12:2356:x1875966758544384:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 537us (2581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061605.250450:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00010000:00010000:3.0:1789061605.251329:0:8285:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.251354:0:8285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.251369:0:8285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.251378:0:8285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.251411:0:8285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789061605.252272:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3310:x1875966779529728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13019us (14248us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789061605.252287:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1789061605.252380:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff971a75cb1500/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789061605.252390:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779529728:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789061605.255991:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061605.256014:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.256034:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061605.256041:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.256055:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.256086:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.256120:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9afdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.256150:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061605.256153:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061605.256155:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061605.290403:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+11:2355:x1875966758544256:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 45954us (50381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061605.290423:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000001:00080000:0.0:1789061605.290476:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1789061605.290510:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1789061605.290520:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1789061605.290527:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1789061605.294819:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061605.294941:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758544640 00000100:00100000:3.0:1789061605.295012:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758544640 00000100:00100000:3.0:1789061605.295127:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:3.0:1789061605.295141:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+15:10560:x1875966758544640:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789061605.295218:0:8391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061605.295255:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9afc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1e3 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.295279:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:3.0:1789061605.295286:0:8391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061605.295332:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9afe3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.295350:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9afe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.295361:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9afe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061605.296303:0:8391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004604ac1 reply state 000000002fd2f326 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9afe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061605.296318:0:8391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061605.296454:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+16:10560:x1875966758544640:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1313us (1648us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789061605.296463:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:2.0:1789061605.300406:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061605.300478:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758544768 00000100:00100000:3.0:1789061605.300533:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758544768 00000100:00100000:3.0:1789061605.300614:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:3.0:1789061605.300653:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758544768:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789061605.300931:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789061605.300936:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789061604 -> 1789061602 00002000:00010000:3.0:1789061605.300939:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789061602 00002000:00010000:3.0:1789061605.300941:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789061604 -> 1789061602 00002000:00010000:3.0:1789061605.300949:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789061605.301026:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2355:x1875966758544768:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 374us (632us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789061605.301034:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:0.0:1789061605.303571:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061605.303696:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758545024 00000100:00100000:2.0:1789061605.303710:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758545024 00000100:00100000:2.0:1789061605.303780:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:2.0:1789061605.303792:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+16:10560:x1875966758545024:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789061605.303887:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.303908:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9afa4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1d5 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.303919:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.303974:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9afa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1d5 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.303993:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9afa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1d5 expref: 16 pid: 5852 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061605.304013:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779530112:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061605.304153:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a79f48780 going to sleep for 11 seconds 00000100:00100000:0.0:1789061605.308172:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061605.308744:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779530112:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061605.308780:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061605.308977:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758545152 00000100:00100000:3.0:1789061605.308989:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758545152 00010000:00010000:3.0:1789061605.309057:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9afa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1d5 expref: 17 pid: 5852 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061605.309112:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:3.0:1789061605.309124:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+17:2356:x1875966758545152:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061605.309145:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061605.309155:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9afa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1d5 expref: 17 pid: 5852 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.309170:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9afa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1d5 expref: 17 pid: 5852 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.309201:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9afa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1d5 expref: 17 pid: 5852 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.309237:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:3.0:1789061605.309243:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.309255:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.309265:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.309312:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061605.309394:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+16:2356:x1875966758545152:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 271us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061605.309403:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00010000:00010000:0.0:1789061605.310183:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.310194:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.310231:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.310238:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.310246:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.310252:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ee00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061605.310258:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.310268:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.310282:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:0.0:1789061605.310285:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789061605.310290:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.310297:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9afea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061605.310384:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+15:10560:x1875966758545024:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 6591us (6824us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789061605.310412:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 126 00010000:00010000:1.0:1789061605.312528:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9afe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.312553:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9afe3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.312562:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9afe3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.312568:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030c00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061605.312575:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9afe3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.312612:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9afe3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.312648:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:1.0:1789061605.312652:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061605.312660:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9afe3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.312677:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9afe3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061605.317252:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061605.317423:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758545280 00000100:00100000:3.0:1789061605.317444:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758545280 00000100:00100000:3.0:1789061605.317544:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1789061605.317557:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2355:x1875966758545280:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789061605.317617:0:8285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.317657:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9afce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f1 expref: 7 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.317668:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061605.317673:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061605.317678:0:8285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.317755:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9afce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f1 expref: 7 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.317772:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9afce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f1 expref: 7 pid: 8285 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061605.317791:0:8285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8285:1875966779530240:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061605.317904:0:8285:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789061605.322462:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061605.322748:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758545408 00000100:00100000:1.0:1789061605.322764:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758545408 00010000:00010000:1.0:1789061605.322825:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9afce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f1 expref: 8 pid: 8285 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061605.322875:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1789061605.322891:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2355:x1875966758545408:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061605.322926:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061605.322968:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9afce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f1 expref: 8 pid: 8285 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.322984:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9afce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f1 expref: 8 pid: 8285 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.323021:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061605.323027:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061605.323064:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.323076:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.323111:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061605.323213:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2355:x1875966758545408:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 328us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061605.323222:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00010000:00010000:3.0:1789061605.324774:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9afce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f1 expref: 7 pid: 8285 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061605.324807:0:8285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8285:1875966779530240:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061605.324837:0:8285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.324850:0:8285:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.324857:0:8285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.324899:0:8285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.330894:0:8285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.330906:0:8285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.330926:0:8285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030000 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061605.330932:0:8285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.331109:0:8285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.331144:0:8285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.331155:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000037af98e/0x427fa11dc4a9aff1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061605.331333:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758545280:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 13766us (14081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061605.331347:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:0.0:1789061605.338824:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061605.339280:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758545664 00000100:00100000:1.0:1789061605.339295:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758545664 00000100:00100000:1.0:1789061605.339385:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:1.0:1789061605.339400:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+14:10560:x1875966758545664:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789061605.339572:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9aff8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.339596:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9aff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.339611:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9aff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.340552:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.340679:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9afb2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1dc expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.340692:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.340783:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9afb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1dc expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.340803:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9afb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1dc expref: 15 pid: 5851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061605.340822:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75f83480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779530368:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061605.341387:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f50780 going to sleep for 11 seconds 00000100:00100000:3.0:1789061605.345522:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061605.345547:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75f83480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779530368:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789061605.345600:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061605.346661:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758545792 00000100:00100000:1.0:1789061605.346679:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758545792 00010000:00010000:1.0:1789061605.346759:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9afb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1dc expref: 16 pid: 5851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061605.346815:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:1.0:1789061605.346848:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+16:2355:x1875966758545792:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061605.346871:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061605.346879:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9afb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1dc expref: 16 pid: 5851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.346895:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9afb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1dc expref: 16 pid: 5851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.346935:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9afb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1dc expref: 16 pid: 5851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.348872:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:1.0:1789061605.348885:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.348901:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.350264:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.350332:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061605.350451:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+15:2355:x1875966758545792:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 3586us (4962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061605.350464:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00010000:00010000:0.0:1789061605.351850:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.351894:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061605.352184:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1789061605.352374:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789061605.352431:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1789061605.352579:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75f83480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5853:1875966779530496:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789061605.352671:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061605.352722:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f50000 going to sleep for 11 seconds 00000100:00100000:2.0:1789061605.352795:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779530496 00000100:00100000:2.0:1789061605.352807:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779530496 00000100:00100000:2.0:1789061605.352873:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789061605.352885:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875966779530496:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789061605.354300:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875966779530496:12345-0@lo:1000:mdt00_002.0 Request processed in 1410us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061605.354315:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789061605.355775:0:5853:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1789061605.355789:0:5853:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1789061605.355816:0:5853:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9719477df480, transno 4294967309 00000100:00100000:0.0:1789061605.355853:0:5853:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff971a75cb1500 x1875966779529728/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789061621 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061605.355870:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75f83480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5853:1875966779530496:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789061605.357170:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1789061605.357301:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75f83480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5853:1875966779530624:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789061605.357398:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061605.357448:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f50780 going to sleep for 11 seconds 00000100:00100000:2.0:1789061605.357604:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779530624 00000100:00100000:2.0:1789061605.357616:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779530624 00000100:00100000:2.0:1789061605.357811:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789061605.357824:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1875966779530624:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789061605.358132:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1875966779530624:12345-0@lo:1000:mdt00_002.0 Request processed in 310us (733us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789061605.358142:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061605.358229:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75f83480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5853:1875966779530624:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789061605.358282:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358294:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358304:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358329:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061605.358335:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358345:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358366:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff971a6af68a00) 00010000:00010000:0.0:1789061605.358370:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789061605.358376:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358384:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9afff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358429:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9af42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358436:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9af42 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358442:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9af42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358448:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061605.358452:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9af42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358459:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9af42 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358479:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:0.0:1789061605.358482:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789061605.358568:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9af49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1c0 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358583:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9af49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1c0 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358594:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9af49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1c0 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.358645:0:5853:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9af49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1c0 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061605.358660:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75f80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779530752:192.168.204.54@tcp:105: 00000100:00100000:0.0:1789061605.358975:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f50780 going to sleep for 11 seconds 00000100:00100000:1.0:1789061605.366592:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061605.367267:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758545920 00000100:00100000:2.0:1789061605.367281:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758545920 00000100:00100000:2.0:1789061605.367355:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:2.0:1789061605.367366:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+19:10559:x1875966758545920:12345-192.168.204.54@tcp:49:lfs.0 00000100:00100000:2.0:1789061605.367569:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+19:10559:x1875966758545920:12345-192.168.204.54@tcp:49:lfs.0 Request processed in 203us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061605.367577:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1789061605.368254:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75f80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779530752:192.168.204.54@tcp:105: 00010000:00010000:3.0:1789061605.368301:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9af42 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368314:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9af42 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368353:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b006 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368368:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b006 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368381:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b006 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368391:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b006 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368398:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b006 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368405:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b006 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368412:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061605.368416:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b006 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368424:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b006 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368436:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:3.0:1789061605.368439:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061605.368448:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b006 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368455:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b006 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368467:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9aff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368473:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9aff8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368479:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9aff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368484:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061605.368515:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9aff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368522:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9aff8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368529:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:3.0:1789061605.368531:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789061605.368534:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9aff8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.368539:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9aff8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061605.368835:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+18:10560:x1875966758545664:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 29437us (30025us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1789061605.368845:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00000020:00080000:3.0:1789061605.368856:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789061605.370597:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061605.370609:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789061605.371140:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789061605.371155:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061605.386142:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061605.386321:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758546176 00000100:00100000:2.0:1789061605.386337:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758546176 00000100:00100000:2.0:1789061605.386416:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1789061605.386428:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a65021c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+18:10560:x1875966758546176:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789061605.390826:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789061605.390978:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1789061605.394365:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b00d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.394399:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b00d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.394416:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b00d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.394428:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b00d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.394435:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b00d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.394441:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b00d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061605.394551:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789061605.394742:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a65021c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+20:10560:x1875966758546176:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 8309us (8611us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789061605.394754:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000020:00080000:2.0:1789061605.394763:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789061605.402873:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061605.402901:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b00d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.403246:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061605.403253:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b00d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.403266:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b00d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.403293:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff971a613b5500) 00010000:00010000:3.0:1789061605.403296:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789061605.403303:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b00d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.403309:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b00d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061605.405360:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:2.0:1789061605.405637:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061605.405643:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061605.405667:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061605.405926:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758546432 00000100:00100000:3.0:1789061605.405947:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758546432 00000100:00100000:3.0:1789061605.406023:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:3.0:1789061605.406043:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+20:10559:x1875966758546432:12345-192.168.204.54@tcp:58:lfs.0 00000040:00080000:3.0:1789061605.406399:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789061605.406556:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+20:10559:x1875966758546432:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 522us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061605.406565:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:1.0:1789061605.471243:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061605.472974:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758546560 00000100:00100000:3.0:1789061605.472993:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758546560 00000100:00100000:3.0:1789061605.473331:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:3.0:1789061605.473366:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+20:10562:x1875966758546560:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061605.473401:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061605.473428:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b014 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1f8 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.473580:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b01b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.473600:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b01b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.473614:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b01b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.473643:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b022 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.473651:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061605.473658:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.476805:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9b029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.477446:0:8391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b9 expref: 21 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.477801:0:8391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9b029 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.477864:0:8391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b9 expref: 21 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.477880:0:8391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b9 expref: 21 pid: 8391 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061605.477899:0:8391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75f82d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8391:1875966779530880:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061605.478225:0:8391:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47f509c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061605.482167:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061605.482317:0:8391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75f82d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8391:1875966779530880:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789061605.482358:0:8391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9b029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061605.482805:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758546816 00000100:00100000:1.0:1789061605.482832:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758546816 00000100:00100000:1.0:1789061605.482906:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1789061605.482918:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+22:5594:x1875966758546816:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789061605.483271:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+23:5594:x1875966758546816:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 355us (1122us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1789061605.483280:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1789061605.486637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061605.486875:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758546944 00000100:00100000:1.0:1789061605.486889:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758546944 00010000:00010000:1.0:1789061605.486957:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b9 expref: 23 pid: 8391 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061605.487010:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:1.0:1789061605.487022:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+23:2356:x1875966758546944:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061605.487205:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061605.487216:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b9 expref: 23 pid: 8391 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.487231:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b9 expref: 23 pid: 8391 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.487261:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9af34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1b9 expref: 23 pid: 8391 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.487287:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:1.0:1789061605.487294:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9b029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.487332:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9b029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.487342:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9b029 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061605.487443:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061605.487600:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+22:2356:x1875966758546944:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 579us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061605.487609:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00010000:00010000:0.0:1789061605.489775:0:8391:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9b029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.489798:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9b029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061605.489864:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789061605.489870:0:8391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061605.489896:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9b029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.489915:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9b029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490022:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b01b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490030:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b01b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490111:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b01b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490118:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061605.490123:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b01b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490132:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b01b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490153:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:0.0:1789061605.490156:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061605.490164:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b01b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490171:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b01b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490196:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490202:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b022 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490208:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490222:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061605.490225:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490231:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b022 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490240:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff971a43636200) 00010000:00010000:0.0:1789061605.490243:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061605.490246:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b022 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490252:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b022 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490319:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b014 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f8 expref: 22 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490340:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9b029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f8 expref: 21 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061605.490350:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:0.0:1789061605.490353:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061605.490356:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c600, rc 0) 00000100:00100000:0.0:1789061605.490592:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+21:10562:x1875966758546560:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 17227us (19363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061605.490602:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:0.0:1789061606.155236:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061606.155283:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779531008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061606.155377:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061606.155463:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779531008 00000100:00100000:0.0:1789061606.155475:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779531008 00000100:00100000:0.0:1789061606.155565:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789061606.155575:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779531008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061606.155637:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061606.155693:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779531008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061606.155701:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789061606.155761:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779531008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789061606.272804:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789061606.397782:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061606.397798:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789061606.397849:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789061606.397862:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789061606.398054:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75f82d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1875966779531136:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789061606.398203:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fdfc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061606.408814:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75f82d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1875966779531136:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789061606.413041:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061606.413109:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758547072 00000100:00100000:1.0:1789061606.413123:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758547072 00000100:00100000:1.0:1789061606.413197:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:1.0:1789061606.413211:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+21:10573:x1875966758547072:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789061606.413270:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789061606.413423:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+21:10573:x1875966758547072:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 215us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061606.413433:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:0.0:1789061606.428082:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061606.428286:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758547328 00000100:00100000:1.0:1789061606.428301:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758547328 00000100:00100000:1.0:1789061606.428384:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:1.0:1789061606.428397:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+21:10573:x1875966758547328:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061606.428424:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061606.428452:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9b030 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a1ff expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061606.428675:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9b037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061606.428695:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9b037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061606.428845:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9b037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061606.428865:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789061606.429070:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9b030 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ff expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061606.429094:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9b037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ff expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061606.429104:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:1.0:1789061606.429107:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061606.429112:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525600, rc 0) 00000100:00100000:1.0:1789061606.429193:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+23:10573:x1875966758547328:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 799us (1128us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789061606.429203:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:2.0:1789061606.440638:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061606.440777:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061606.440823:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758547584 00000100:00100000:2.0:1789061606.440837:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758547584 00000100:00100000:2.0:1789061606.440909:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:2.0:1789061606.440928:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+23:10573:x1875966758547584:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789061606.441055:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b045 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061606.441078:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061606.441096:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061606.441377:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061606.441387:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b045 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061606.441395:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b045 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061606.441403:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061606.441408:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b045 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061606.441441:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b045 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061606.441457:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:2.0:1789061606.441460:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789061606.441467:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b045 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061606.441473:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b045 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061606.441759:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+24:10573:x1875966758547584:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 836us (978us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789061606.441769:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 132 00000040:00080000:2.0:1789061606.442081:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789061606.442087:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789061606.442624:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789061606.442636:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061606.443115:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758547712 00000100:00100000:1.0:1789061606.443128:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758547712 00000100:00100000:1.0:1789061606.443201:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1789061606.443213:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+24:2356:x1875966758547712:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061606.443233:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061606.443279:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9b037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1ff expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061606.443300:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:1.0:1789061606.443306:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061606.443377:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+23:2356:x1875966758547712:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 167us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061606.443386:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1789061606.457556:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061606.457670:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758547968 00000100:00100000:3.0:1789061606.457684:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758547968 00000100:00100000:3.0:1789061606.458008:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:3.0:1789061606.458023:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+23:10573:x1875966758547968:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789061606.458354:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+24:10573:x1875966758547968:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 334us (815us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789061606.458383:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000040:00080000:0.0:1789061606.738436:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061606.738449:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789061606.738533:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789061606.738545:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061606.992053:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061606.992141:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758548224 00000100:00100000:3.0:1789061606.992155:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758548224 00000100:00100000:3.0:1789061606.992240:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:3.0:1789061606.992253:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+24:10586:x1875966758548224:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061606.992291:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061606.992321:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9b04c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a206 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061606.992466:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9b053 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061606.992530:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9b053 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061606.992548:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9b053 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061606.992562:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789061606.992742:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030400/0x427fa11dc4a9b04c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a206 expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061606.992766:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9b053 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a206 expref: 26 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061606.992775:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:3.0:1789061606.992778:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789061606.992783:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40030c00, rc 0) 00000100:00100000:3.0:1789061606.992876:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+26:10586:x1875966758548224:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 625us (836us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789061606.992883:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:3.0:1789061607.000883:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061607.000996:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758548352 00000100:00100000:1.0:1789061607.001010:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758548352 00000100:00100000:1.0:1789061607.001109:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00100000:1.0:1789061607.001124:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+26:10586:x1875966758548352:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1789061607.001220:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b061 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061607.001242:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061607.001256:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061607.001292:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061607.001300:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b061 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061607.001307:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061607.001313:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525e00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061607.001330:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061607.001340:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b061 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061607.001356:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:1.0:1789061607.001359:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789061607.001365:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b061 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061607.001373:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b061 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061607.001466:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+26:10586:x1875966758548352:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 346us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061607.001474:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00080000:0.0:1789061607.001897:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061607.126059:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061607.126110:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758548480 00000100:00100000:3.0:1789061607.126123:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758548480 00000100:00100000:3.0:1789061607.126206:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:3.0:1789061607.126219:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2354:x1875966758548480:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1789061607.126244:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061607.126272:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9b068 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a20d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789061607.126309:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa2e9e2, atime: 0x6aa2e9e2, ctime: 0x6aa2e9e2, blocks: 0xb 00010000:00010000:3.0:1789061607.126350:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1789061607.126355:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061607.126366:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9b068 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a20d expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061607.126389:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9b068 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a20d expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061607.126405:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40030400, rc 0) 00000100:00100000:3.0:1789061607.126514:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2354:x1875966758548480:12345-192.168.204.54@tcp:101:cat.0 Request processed in 266us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061607.126523:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00080000:3.0:1789061607.126569:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061607.138126:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061607.138941:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758548608 00000100:00100000:0.0:1789061607.138958:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758548608 00002000:00100000:0.0:1789061607.139029:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff971a75aee680 x1875966758548608/t0(0) o3->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:28/0 lens 488/0 e 0 to 0 dl 1789061618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061607.139064:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a75aee680 with x1875966758548608 ext(0->4095) 00002000:00010000:0.0:1789061607.139072:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971a75aee680 00000100:00100000:0.0:1789061607.139109:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:0.0:1789061607.139122:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2353:x1875966758548608:12345-192.168.204.54@tcp:3:cat.0 00000100:00100000:0.0:1789061607.139583:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2353:x1875966758548608:12345-192.168.204.54@tcp:3:cat.0 Request processed in 461us (1469us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789061607.139592:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00002000:00100000:0.0:1789061607.139614:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff971a75aee680 x1875966758548608/t0(0) o3->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:28/0 lens 488/4536 e 0 to 0 dl 1789061618 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061607.139623:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a75aee680 with x1875966758548608 ext(0->4095) 00002000:00010000:0.0:1789061607.139627:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971a75aee680 00000100:00100000:3.0:1789061607.142225:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061607.142332:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061607.142368:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061607.142405:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758548992 00000100:00100000:3.0:1789061607.142417:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758548992 00000100:00100000:3.0:1789061607.142520:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:3.0:1789061607.142533:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758548992:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061607.142641:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758548992:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 110us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061607.142661:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00080000:3.0:1789061607.142690:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061607.143131:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758548736 00000100:00100000:2.0:1789061607.143138:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758548736 00000100:00100000:2.0:1789061607.143179:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 295 00000100:00100000:2.0:1789061607.143188:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758548736:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061607.143234:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758548736:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 47us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061607.143263:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 295 00000100:00100000:0.0:1789061607.144311:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758548864 00000100:00100000:0.0:1789061607.144381:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758548864 00000100:00100000:0.0:1789061607.144507:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:0.0:1789061607.144518:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758548864:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:3.0:1789061607.145546:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061607.146353:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758548864:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 1826us (4130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061607.146370:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00010000:00010000:1.0:1789061607.295630:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061608.190653:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779531392:0@lo:400:kworker.0 00000100:00100000:1.0:1789061608.190761:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061608.190832:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779531392 00000100:00100000:1.0:1789061608.190844:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779531904:0@lo:400:kworker.0 00000100:00100000:2.0:1789061608.190845:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779531392 00000100:00100000:1.0:1789061608.190880:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061608.190919:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061608.190923:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789061608.190929:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779531520:0@lo:400:kworker.0 00000100:00100000:2.0:1789061608.190937:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779531392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061608.190971:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061608.191011:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779531904 00000100:00100000:1.0:1789061608.191017:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779531904 00000100:00100000:2.0:1789061608.191026:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779531392:12345-0@lo:400:kworker.0 Request processed in 92us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061608.191035:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789061608.191061:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779531520 00000100:00100000:2.0:1789061608.191066:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779531520 00000100:00100000:1.0:1789061608.191075:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789061608.191087:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875966779531904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061608.191098:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789061608.191107:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779531520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061608.191150:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779531520:12345-0@lo:400:kworker.0 Request processed in 45us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061608.191161:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875966779531904:12345-0@lo:400:kworker.0 Request processed in 77us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061608.191170:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789061608.191171:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789061608.191202:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061608.191208:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061608.191238:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779531520:0@lo:400:kworker.0 00000100:00100000:0.0:1789061608.191435:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779531264:0@lo:400:kworker.0 00000100:00100000:0.0:1789061608.191483:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061608.191547:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779531776:0@lo:400:kworker.0 00000100:00100000:0.0:1789061608.191582:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061608.191607:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061608.191624:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779531648:0@lo:400:kworker.0 00000100:00100000:2.0:1789061608.191638:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779531776 00000100:00100000:2.0:1789061608.191645:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779531776 00000100:00100000:0.0:1789061608.191675:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061608.191686:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789061608.191695:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779531776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061608.191712:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779531648 00000100:00100000:0.0:1789061608.191718:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779531648 00000100:00100000:0.0:1789061608.191760:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789061608.191773:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779531648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061608.191805:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779531776:12345-0@lo:400:kworker.0 Request processed in 110us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061608.191813:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789061608.191838:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779531264 00000100:00100000:0.0:1789061608.191841:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779531648:12345-0@lo:400:kworker.0 Request processed in 68us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061608.191843:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779531264 00000100:00100000:0.0:1789061608.191856:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789061608.191875:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789061608.191891:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779531264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061608.191905:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779531648:0@lo:400:kworker.0 00000100:00100000:0.0:1789061608.191919:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779531776:0@lo:400:kworker.0 00000100:00100000:2.0:1789061608.191931:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779531264:12345-0@lo:400:kworker.0 Request processed in 40us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061608.191938:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:2.0:1789061608.191972:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061608.191976:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061608.192011:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779531264:0@lo:400:kworker.0 00000100:00100000:1.0:1789061608.192340:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779531392:0@lo:400:kworker.0 00000100:00100000:1.0:1789061608.192358:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779531904:0@lo:400:kworker.0 00010000:00010000:2.0:1789061608.318126:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061608.718810:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779532032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061608.720971:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061608.732672:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779532032 00000100:00100000:2.0:1789061608.732687:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779532032 00000100:00100000:2.0:1789061608.732742:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789061608.732753:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875966779532032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789061608.732797:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061608.734673:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875966779532032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1913us (13700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061608.734688:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789061608.737360:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779532032:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1789061608.801593:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:0.0:1789061609.345359:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789061610.365735:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:3.0:1789061610.365766:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff971a47f50000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789061610.365772:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a7ce8d100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff971a47f506c0 00000020:00080000:3.0:1789061610.365776:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a7ce8db00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9719477e5800 00000001:00080000:3.0:1789061610.365814:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:3.0:1789061610.365829:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:3.0:1789061610.365843:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1789061610.365870:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789061610.369292:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789061610.369632:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789061610.372460:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789061610.812459:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1789061610.812483:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:1.0:1789061611.262378:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061611.262412:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779532160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061611.262563:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061611.262683:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779532160 00000100:00100000:3.0:1789061611.262693:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779532160 00000100:00100000:3.0:1789061611.262775:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789061611.262787:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779532160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789061611.262843:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061611.262921:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779532160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061611.262929:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1789061611.263077:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061611.263109:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789061611.263116:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff971a75867800, transno 4294967304 00000100:00100000:1.0:1789061611.263143:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779532160:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789061611.393160:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789061611.582642:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061611.582657:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061611.582701:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789061611.582710:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061612.264953:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061612.264998:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061612.265024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061612.265046:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061612.265111:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061612.265147:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758549632 00000100:00100000:2.0:1789061612.265161:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758549632 00000100:00100000:2.0:1789061612.265232:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758549248 00000100:00100000:2.0:1789061612.265243:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758549248 00000100:00100000:2.0:1789061612.265274:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:2.0:1789061612.265285:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2353:x1875966758549632:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061612.265388:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2353:x1875966758549632:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 105us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061612.265397:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:2.0:1789061612.265421:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 151 00000100:00100000:2.0:1789061612.265428:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+13:2353:x1875966758549248:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061612.265450:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+13:2353:x1875966758549248:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061612.265456:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 151 00000100:00100000:1.0:1789061612.265778:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758549120 00000100:00100000:1.0:1789061612.265784:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758549120 00000100:00100000:1.0:1789061612.265828:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 297 00000100:00100000:1.0:1789061612.265836:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2353:x1875966758549120:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061612.265864:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2353:x1875966758549120:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061612.265870:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 297 00000100:00100000:1.0:1789061612.265913:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758549376 00000100:00100000:1.0:1789061612.265916:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758549376 00000100:00100000:1.0:1789061612.265946:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758549504 00000100:00100000:1.0:1789061612.265949:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758549504 00000100:00100000:1.0:1789061612.265971:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:1.0:1789061612.265977:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2353:x1875966758549376:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061612.266004:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2353:x1875966758549376:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061612.266010:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:1.0:1789061612.266019:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:1.0:1789061612.266025:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2353:x1875966758549504:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061612.266044:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2353:x1875966758549504:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 20us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061612.266050:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00080000:1.0:1789061612.266070:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061612.266075:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061612.266078:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789061612.414204:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061612.827837:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061612.828431:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758549760 00000100:00100000:0.0:1789061612.828448:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758549760 00000100:00100000:0.0:1789061612.828591:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:0.0:1789061612.828617:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+13:10247:x1875966758549760:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789061612.828776:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+13:10247:x1875966758549760:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 174us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061612.828785:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:3.0:1789061612.834134:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061612.834463:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758550016 00000100:00100000:0.0:1789061612.834795:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758550016 00000100:00100000:0.0:1789061612.834885:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1789061612.834902:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+13:10247:x1875966758550016:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789061612.837727:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+14:10247:x1875966758550016:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 2812us (3591us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789061612.837747:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:3.0:1789061613.310055:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789061613.310091:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779532416:0@lo:400:kworker.0 00000100:00100000:3.0:1789061613.310186:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061613.310277:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779532416 00000100:00100000:3.0:1789061613.310288:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779532416 00000100:00100000:3.0:1789061613.310352:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789061613.310361:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779532416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061613.310426:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779532416:12345-0@lo:400:kworker.0 Request processed in 66us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061613.310434:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789061613.310996:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779532288:0@lo:400:kworker.0 00000100:00100000:1.0:1789061613.311053:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061613.311151:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061613.311158:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779532672:0@lo:400:kworker.0 00000100:00100000:1.0:1789061613.311187:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061613.311218:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779532672 00000100:00100000:1.0:1789061613.311224:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779532672 00000100:00100000:1.0:1789061613.311272:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789061613.311281:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779532672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061613.311326:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779532672:12345-0@lo:400:kworker.0 Request processed in 47us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061613.311355:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1789061613.311376:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061613.311411:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779532672:0@lo:400:kworker.0 00000100:00100000:1.0:1789061613.311449:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779532800:0@lo:400:kworker.0 00000100:00100000:1.0:1789061613.311507:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061613.311944:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779532800 00000100:00100000:0.0:1789061613.311951:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779532800 00000100:00100000:0.0:1789061613.311995:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789061613.312004:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779532800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061613.312060:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779532800:12345-0@lo:400:kworker.0 Request processed in 59us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061613.312067:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1789061613.312086:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061613.312120:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779532800:0@lo:400:kworker.0 00000100:00100000:2.0:1789061613.312313:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779532928:0@lo:400:kworker.0 00000100:00100000:2.0:1789061613.312353:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061613.312444:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061613.312451:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779532544:0@lo:400:kworker.0 00000100:00100000:2.0:1789061613.312508:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061613.312553:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779532288 00000100:00100000:2.0:1789061613.312558:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779532288 00000100:00100000:3.0:1789061613.312675:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779532416:0@lo:400:kworker.0 00000100:00100000:3.0:1789061613.312702:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779532544 00000100:00100000:3.0:1789061613.312706:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779532544 00000100:00100000:2.0:1789061613.312876:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789061613.312886:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779532288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061613.312933:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779532288:12345-0@lo:400:kworker.0 Request processed in 50us (1880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061613.312940:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789061613.314029:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789061613.314046:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779532544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061613.314140:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779532544:12345-0@lo:400:kworker.0 Request processed in 100us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061613.314148:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789061613.314246:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779532544:0@lo:400:kworker.0 00000100:00100000:0.0:1789061613.317744:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779532928 00000100:00100000:0.0:1789061613.317767:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779532928 00000100:00100000:0.0:1789061613.317984:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789061613.317998:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779532928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061613.318145:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779532928:12345-0@lo:400:kworker.0 Request processed in 151us (5790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061613.318153:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1789061613.318181:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061613.318186:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061613.318226:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779532288:0@lo:400:kworker.0 00000100:00100000:2.0:1789061613.321392:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1789061613.321410:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff971a75cb1500, transno 4294967310 00000004:00080000:2.0:1789061613.321447:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1789061613.321529:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779532928:0@lo:400:kworker.0 00010000:00010000:0.0:1789061613.450205:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061613.821734:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061613.827859:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779533056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061613.827984:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061613.828272:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779533056 00000100:00100000:3.0:1789061613.828283:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779533056 00000100:00100000:3.0:1789061613.828356:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789061613.828366:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779533056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061613.828437:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061613.828541:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779533056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061613.828548:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789061613.828719:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779533056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789061614.461958:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789061615.153120:0:12281:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 13:33:32 (1789061612) 00010000:00010000:1.0:1789061615.492329:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789061615.502579:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1789061615.502597:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789061615.503319:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789061615.503333:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789061616.387007:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779533184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061616.387109:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061616.387349:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779533184 00000100:00100000:3.0:1789061616.387360:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779533184 00000100:00100000:3.0:1789061616.387544:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789061616.387558:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779533184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789061616.387616:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061616.387687:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779533184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061616.387695:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789061616.387796:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779533184:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789061616.390014:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789061616.509776:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061617.000426:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061617.000670:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758550272 00000100:00100000:0.0:1789061617.000684:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758550272 00000100:00080000:2.0:1789061617.000859:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061617.000976:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:0.0:1789061617.000992:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+13:11298:x1875966758550272:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789061617.001024:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061617.001053:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b06f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a214 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.001153:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b076 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.001173:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b076 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.001188:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b076 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.001206:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b07d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.001233:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b07d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.001255:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b07d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.001673:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b084 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.001684:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b084 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.001692:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b084 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061617.001704:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789061617.002207:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b076 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.002217:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b076 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.002224:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b076 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.002231:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061617.002236:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b076 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.002360:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b076 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.002390:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff971a613b5200) 00010000:00010000:0.0:1789061617.002393:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061617.002400:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b076 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.002417:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b076 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.002434:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b07d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.002441:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b07d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.002447:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b07d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.002453:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596de00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061617.002456:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b07d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.002462:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b07d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.002470:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff971a610eeb00) 00010000:00010000:0.0:1789061617.002472:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061617.002475:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b07d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.002481:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b07d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.004688:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b06f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a214 expref: 16 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.004723:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b084 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a214 expref: 15 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061617.004734:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee800) 00010000:00010000:0.0:1789061617.004737:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061617.004742:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596da00, rc 0) 00000100:00100000:0.0:1789061617.006506:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+15:11298:x1875966758550272:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 5488us (6077us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789061617.006524:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:2.0:1789061617.012998:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061617.013051:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061617.013137:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758550528 00000100:00100000:1.0:1789061617.013153:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758550528 00000100:00100000:1.0:1789061617.013376:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1789061617.013390:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+15:2354:x1875966758550528:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061617.013424:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061617.013458:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b084 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a214 expref: 15 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061617.013484:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee800) 00010000:00010000:1.0:1789061617.013529:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061617.013605:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+14:2354:x1875966758550528:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 218us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061617.013622:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789061617.013707:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758550400 00000100:00100000:3.0:1789061617.013713:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758550400 00000100:00100000:3.0:1789061617.013759:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:3.0:1789061617.013767:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+14:11298:x1875966758550400:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789061617.013862:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+14:11298:x1875966758550400:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 96us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061617.013880:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:0.0:1789061617.383220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061617.383266:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061617.383308:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061617.383332:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061617.383361:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061617.383395:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758551168 00000100:00100000:0.0:1789061617.383419:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758551168 00000100:00100000:0.0:1789061617.383575:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758550784 00000100:00100000:0.0:1789061617.383579:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758550784 00000100:00100000:0.0:1789061617.383607:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:0.0:1789061617.383618:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758551168:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061617.383720:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758551168:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 103us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061617.383730:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:0.0:1789061617.383779:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:0.0:1789061617.383787:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+14:2356:x1875966758550784:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061617.383816:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+14:2356:x1875966758550784:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061617.383822:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:0.0:1789061617.383848:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758550912 00000100:00100000:0.0:1789061617.383853:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758550912 00000100:00100000:0.0:1789061617.383882:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758551040 00000100:00100000:0.0:1789061617.383885:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758551040 00000100:00100000:0.0:1789061617.383906:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:0.0:1789061617.383914:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758550912:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061617.383942:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758550912:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061617.383948:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:0.0:1789061617.383960:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:0.0:1789061617.383966:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758551040:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061617.383991:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758551040:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061617.383997:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00080000:0.0:1789061617.384037:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061617.384042:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789061617.384044:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061617.384424:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758550656 00000100:00100000:1.0:1789061617.384430:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758550656 00000100:00100000:1.0:1789061617.384464:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 299 00000100:00100000:1.0:1789061617.384472:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758550656:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061617.384531:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758550656:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 59us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061617.384547:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 299 00010000:00010000:2.0:1789061617.536213:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789061617.725787:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061617.725799:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061617.726265:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789061617.726276:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061618.431981:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779533440:0@lo:400:kworker.0 00000100:00100000:2.0:1789061618.432088:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061618.432154:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779533952:0@lo:400:kworker.0 00000100:00100000:2.0:1789061618.432186:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061618.432225:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061618.432232:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779533568:0@lo:400:kworker.0 00000100:00100000:2.0:1789061618.432262:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061618.432314:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779533440 00000100:00100000:2.0:1789061618.432326:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779533440 00000100:00100000:2.0:1789061618.432409:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779533568 00000100:00100000:2.0:1789061618.432413:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779533568 00000100:00100000:2.0:1789061618.432456:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789061618.432465:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779533440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061618.432554:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779533440:12345-0@lo:400:kworker.0 Request processed in 90us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061618.432561:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789061618.432689:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779533696:0@lo:400:kworker.0 00000100:00100000:3.0:1789061618.432724:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061618.432748:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789061618.432754:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779533312:0@lo:400:kworker.0 00000100:00100000:3.0:1789061618.432794:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061618.432820:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779533824:0@lo:400:kworker.0 00000100:00100000:3.0:1789061618.432843:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061618.432864:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779533952 00000100:00100000:3.0:1789061618.432868:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779533952 00000100:00100000:3.0:1789061618.432900:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779533696 00000100:00100000:3.0:1789061618.432903:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779533696 00000100:00100000:3.0:1789061618.432926:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789061618.432933:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779533952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061618.432967:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779533952:12345-0@lo:400:kworker.0 Request processed in 35us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061618.432974:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789061618.432988:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789061618.432994:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779533696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061618.433025:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779533696:12345-0@lo:400:kworker.0 Request processed in 31us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061618.433030:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789061618.433082:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779533696:0@lo:400:kworker.0 00000100:00100000:2.0:1789061618.433195:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779533824 00000100:00100000:2.0:1789061618.433199:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779533824 00000100:00100000:2.0:1789061618.433219:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789061618.433225:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779533568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061618.433257:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779533568:12345-0@lo:400:kworker.0 Request processed in 32us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061618.433262:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789061618.433275:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789061618.433281:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779533824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061618.433347:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779533824:12345-0@lo:400:kworker.0 Request processed in 66us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061618.433353:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1789061618.433397:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061618.433402:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061618.433405:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061618.433425:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779533312 00000100:00100000:2.0:1789061618.433428:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779533312 00000100:00100000:2.0:1789061618.433520:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789061618.433529:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779533312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061618.433562:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779533312:12345-0@lo:400:kworker.0 Request processed in 35us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061618.433568:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789061618.433650:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779533312:0@lo:400:kworker.0 00000100:00100000:3.0:1789061618.433663:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779533824:0@lo:400:kworker.0 00000100:00100000:2.0:1789061618.447132:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779533568:0@lo:400:kworker.0 00000100:00100000:2.0:1789061618.447159:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779533440:0@lo:400:kworker.0 00000100:00100000:2.0:1789061618.447174:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779533952:0@lo:400:kworker.0 00010000:00010000:2.0:1789061618.557672:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061618.941729:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779534080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061618.941837:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061618.942167:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779534080 00000100:00100000:1.0:1789061618.942178:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779534080 00000100:00100000:1.0:1789061618.942239:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789061618.942249:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779534080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061618.942295:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061618.942355:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779534080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061618.942362:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789061618.942434:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779534080:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789061619.582437:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061619.617928:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061619.618027:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758551296 00000100:00100000:2.0:1789061619.618043:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758551296 00000100:00100000:2.0:1789061619.618179:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:2.0:1789061619.618193:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+14:11340:x1875966758551296:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061619.618231:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061619.618261:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b092 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a21b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.618344:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b099 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.618375:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b099 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.618393:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b099 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.618411:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b0a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.618419:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.618426:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620094:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b099 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620116:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b099 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620136:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b099 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620142:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fc00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061619.620148:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b099 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620157:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b099 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620176:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a613b5000) 00010000:00010000:2.0:1789061619.620179:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061619.620184:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b099 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620191:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b099 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620206:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620212:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b0a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620217:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620433:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fe00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061619.620437:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620455:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620465:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff971a613b5e00) 00010000:00010000:2.0:1789061619.620468:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061619.620471:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b0a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620477:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b0a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620629:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b092 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a21b expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620643:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a613b5000) 00010000:00010000:2.0:1789061619.620646:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061619.620650:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b092 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a21b expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.620662:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63ee00, rc 0) 00000100:00100000:2.0:1789061619.621654:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+14:11340:x1875966758551296:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 3454us (3731us total) trans 0 rc 301/301 00000100:00100000:2.0:1789061619.621666:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00080000:0.0:1789061619.623367:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061619.641176:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061619.641331:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758551552 00000100:00100000:3.0:1789061619.641346:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758551552 00000100:00100000:3.0:1789061619.641449:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 139 00000100:00100000:3.0:1789061619.641474:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+14:11340:x1875966758551552:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:3.0:1789061619.641594:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061619.641630:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9aa1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a05b expref: 14 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.641655:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a613b5000) 00010000:00010000:3.0:1789061619.641668:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061619.641985:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0a7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.642003:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.642016:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.642030:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.642038:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.642045:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061619.643184:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789061619.643206:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.643216:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0a7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.643236:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.643243:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061619.643248:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.643257:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0a7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.643275:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636700) 00010000:00010000:3.0:1789061619.643279:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061619.643285:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.643292:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0a7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061619.643316:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008589c4b3 reply state 000000000cd845f3 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061619.643327:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061619.643519:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+15:11340:x1875966758551552:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 2010us (2325us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789061619.643530:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 139 00010000:00010000:1.0:1789061619.648939:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061619.648962:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0ae lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061619.648971:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061619.648979:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061619.648984:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061619.649006:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0ae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061619.649028:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff971a43636300) 00010000:00010000:1.0:1789061619.649031:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061619.649038:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0ae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061619.649045:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0ae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061619.758371:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061619.758995:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758551680 00000100:00100000:0.0:1789061619.759011:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758551680 00000100:00100000:0.0:1789061619.759158:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 140 00000100:00100000:0.0:1789061619.759171:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+14:11348:x1875966758551680:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:0.0:1789061619.759208:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061619.759238:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9b0b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a222 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061619.759333:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9b0bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061619.759351:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9b0bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061619.759377:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9b0bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061619.759435:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789061619.759440:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061619.759468:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9b0bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061619.759538:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9b0b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a222 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061619.759561:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9b0bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a222 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061619.759571:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:0.0:1789061619.759575:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061619.759579:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596ce00, rc 0) 00000100:00100000:0.0:1789061619.760997:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+15:11348:x1875966758551680:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 503us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061619.761035:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 140 00000100:00100000:0.0:1789061619.865148:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061619.865274:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758551808 00000100:00100000:3.0:1789061619.865289:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758551808 00000100:00100000:3.0:1789061619.865387:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:3.0:1789061619.865399:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+15:11354:x1875966758551808:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789061619.865462:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061619.865552:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a229 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.865651:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.865682:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.865701:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.865719:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.865725:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.865731:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866147:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866157:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866165:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061619.866202:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789061619.866216:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789061619.866242:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866256:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866263:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866271:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866277:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061619.866282:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866291:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866306:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:3.0:1789061619.866310:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061619.866315:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866322:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866341:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866348:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866378:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866384:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40031400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061619.866387:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.866393:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.867055:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff971a43636700) 00010000:00010000:3.0:1789061619.867061:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061619.867068:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.867076:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.867137:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a229 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.867155:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a229 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.867163:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:3.0:1789061619.867166:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789061619.867168:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40030600, rc 0) 00000100:00100000:3.0:1789061619.867272:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+16:11354:x1875966758551808:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1874us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061619.867297:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:1.0:1789061619.881265:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061619.881541:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758552064 00000100:00100000:3.0:1789061619.881555:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758552064 00000100:00100000:3.0:1789061619.881626:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:3.0:1789061619.881638:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+16:11354:x1875966758552064:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789061619.881820:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061619.881855:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a230 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.883206:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.883236:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.883251:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.883667:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.883692:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.883707:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789061619.890013:0:8391:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789061619.890288:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9b0f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.893453:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9b0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.893472:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9b0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.893718:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.893726:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.894398:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.894410:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40031400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061619.894416:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.894425:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.894441:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:3.0:1789061619.894444:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061619.894449:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.894455:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b0e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061619.894476:0:8391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007475ed71 reply state 000000006d979c25 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061619.894628:0:8391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789061619.897233:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b0df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a230 expref: 19 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.897268:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9b0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a230 expref: 18 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.897278:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636200) 00010000:00010000:3.0:1789061619.897281:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061619.897285:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476600, rc 0) 00000100:00100000:3.0:1789061619.897390:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+19:11354:x1875966758552064:12345-192.168.204.54@tcp:101:bash.0 Request processed in 15753us (16139us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789061619.897399:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 142 00010000:00010000:2.0:1789061619.901479:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.901565:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.901573:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.901580:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061619.901586:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.901594:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.901612:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a43636700) 00010000:00010000:2.0:1789061619.901616:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061619.901622:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.901629:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b0ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061619.911089:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061619.911278:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758552192 00000100:00100000:3.0:1789061619.911295:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758552192 00000100:00100000:3.0:1789061619.911425:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:3.0:1789061619.911439:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758552192:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789061619.911464:0:8285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061619.911550:0:8285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a051b79/0x427fa11dc4a9b102 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a237 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789061619.911589:0:8285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789061619.911621:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1789061619.911626:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061619.911637:0:8285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a051b79/0x427fa11dc4a9b102 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a237 expref: 6 pid: 8285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.911688:0:8285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a051b79/0x427fa11dc4a9b102 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a237 expref: 6 pid: 8285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.911705:0:8285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476c00, rc 0) 00000100:00100000:3.0:1789061619.911792:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758552192:12345-192.168.204.54@tcp:101:bash.0 Request processed in 357us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061619.911800:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00080000:0.0:1789061619.911898:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061619.917936:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061619.918097:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758552320 00000100:00100000:3.0:1789061619.918112:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758552320 00000100:00100000:3.0:1789061619.918188:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1789061619.918201:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+6:11354:x1875966758552320:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789061619.918226:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061619.918252:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a23e expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.918295:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a051b79/0x427fa11dc4a9b102 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a237 expref: 7 pid: 8285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.918305:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061619.918311:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061619.918317:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.918370:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a051b79/0x427fa11dc4a9b102 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a237 expref: 7 pid: 8285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.918405:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a051b79/0x427fa11dc4a9b102 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a237 expref: 7 pid: 8285 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061619.918421:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6702:1875966779534208:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061619.918593:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061619.923031:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6702:1875966779534208:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061619.923088:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061619.923116:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40030800, rc 0) 00000100:00100000:3.0:1789061619.923212:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:11354:x1875966758552320:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5013us (5301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061619.923223:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:0.0:1789061619.923639:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061619.924807:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758552448 00000100:00100000:2.0:1789061619.924825:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758552448 00010000:00010000:2.0:1789061619.924885:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a051b79/0x427fa11dc4a9b102 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a237 expref: 7 pid: 8285 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061619.924951:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:2.0:1789061619.924964:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2355:x1875966758552448:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061619.924984:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061619.925032:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a051b79/0x427fa11dc4a9b102 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a237 expref: 7 pid: 8285 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.925049:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a051b79/0x427fa11dc4a9b102 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a237 expref: 7 pid: 8285 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.925079:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a051b79/0x427fa11dc4a9b102 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a237 expref: 7 pid: 8285 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.925104:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061619.925109:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061619.925119:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.925132:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061619.925215:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061619.925232:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5836:1875966779534336:192.168.204.54@tcp:105: 00000100:00100000:2.0:1789061619.925341:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a52398240 going to sleep for 11 seconds 00000100:00100000:2.0:1789061619.936111:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061619.936401:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5836:1875966779534336:192.168.204.54@tcp:105: 00010000:00010000:1.0:1789061619.936437:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061619.936550:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758552448:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 11587us (12912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061619.936565:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:3.0:1789061619.937205:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758552704 00000100:00100000:3.0:1789061619.937221:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758552704 00000100:00100000:3.0:1789061619.937279:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:3.0:1789061619.937291:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+18:11354:x1875966758552704:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1789061619.937814:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+19:11354:x1875966758552704:12345-192.168.204.54@tcp:35:bash.0 Request processed in 523us (1717us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789061619.937824:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1789061620.065211:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061620.065655:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758552960 00000100:00100000:3.0:1789061620.065682:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758552960 00000100:00100000:3.0:1789061620.065926:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:3.0:1789061620.065941:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+19:11365:x1875966758552960:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061620.065998:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061620.066029:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b110 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061620.066156:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789061620.066319:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b110 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a245 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.066338:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:3.0:1789061620.066343:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789061620.066361:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b110 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a245 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.066382:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a40030000, rc 0) 00000100:00100000:3.0:1789061620.066475:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+20:11365:x1875966758552960:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 537us (1280us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1789061620.066483:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:0.0:1789061620.079389:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061620.080012:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758553216 00000100:00100000:3.0:1789061620.080028:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758553216 00000100:00100000:3.0:1789061620.080106:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:3.0:1789061620.080118:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+20:11365:x1875966758553216:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789061620.080465:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+21:11365:x1875966758553216:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 346us (1088us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789061620.080474:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:0.0:1789061620.178146:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061620.178327:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758553344 00000100:00100000:2.0:1789061620.178341:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758553344 00000100:00100000:2.0:1789061620.178432:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:2.0:1789061620.178460:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+21:11371:x1875966758553344:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061620.178546:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061620.178574:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b11e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a24c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.178679:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.178696:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.178710:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061620.178759:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789061620.178764:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061620.178787:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.178820:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b11e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a24c expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.178844:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a24c expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.178853:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:2.0:1789061620.178857:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061620.178862:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fc00, rc 0) 00000100:00100000:2.0:1789061620.178940:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+22:11371:x1875966758553344:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 482us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061620.178959:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:0.0:1789061620.189405:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061620.189672:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758553600 00000100:00100000:2.0:1789061620.189687:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758553600 00000100:00100000:2.0:1789061620.189770:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:2.0:1789061620.189784:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+22:11371:x1875966758553600:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061620.189817:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061620.189846:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b12c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a253 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.189998:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b133 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.190019:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.190035:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061620.190051:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789061620.190245:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b12c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a253 expref: 25 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.190270:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a253 expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.190280:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636200) 00010000:00010000:2.0:1789061620.190283:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061620.190288:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fe00, rc 0) 00000100:00100000:2.0:1789061620.190402:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+24:11371:x1875966758553600:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 621us (1013us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789061620.190410:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:0.0:1789061620.196355:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061620.196536:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758553728 00000100:00100000:2.0:1789061620.196551:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758553728 00000100:00100000:2.0:1789061620.196641:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1789061620.196653:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+24:2356:x1875966758553728:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061620.196683:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061620.196718:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b133 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a253 expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.196744:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636200) 00010000:00010000:2.0:1789061620.196751:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061620.196824:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+23:2356:x1875966758553728:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 174us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061620.196832:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1789061620.205889:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061620.206721:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758553984 00000100:00100000:2.0:1789061620.206737:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758553984 00000100:00100000:2.0:1789061620.206827:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:2.0:1789061620.206842:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+23:11371:x1875966758553984:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061620.206879:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061620.206907:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a25a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.207064:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b148 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.207106:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b148 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.207120:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b148 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061620.207136:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789061620.207303:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a25a expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.207326:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b148 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a25a expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.207336:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636200) 00010000:00010000:2.0:1789061620.207340:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789061620.207356:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e400, rc 0) 00000100:00100000:2.0:1789061620.207586:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+25:11371:x1875966758553984:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 747us (1713us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789061620.207603:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:0.0:1789061620.222226:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061620.222376:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758554112 00000100:00100000:3.0:1789061620.222390:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758554112 00000100:00100000:1.0:1789061620.223737:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1789061620.223783:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758554112:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:1.0:1789061620.223861:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.224056:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.224069:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061620.224092:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061620.224098:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.224161:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.224178:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 6 pid: 6702 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061620.224195:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6699:1875966779534464:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061620.224592:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a43c7b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789061620.230275:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6699:1875966779534464:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789061620.230330:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061620.232424:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061620.233671:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758554240 00000100:00100000:2.0:1789061620.233691:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758554240 00002000:00100000:2.0:1789061620.233780:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff971a75b16d80 x1875966758554240/t0(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:41/0 lens 504/0 e 0 to 0 dl 1789061631 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789061620.233793:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a75b16d80 with x1875966758554240 ext(0->12) 00010000:00010000:2.0:1789061620.235311:0:6707:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 7 pid: 6702 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.235423:0:6707:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 7 pid: 6702 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789061620.235436:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff971a75b16d80 00000100:00100000:2.0:1789061620.238141:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1789061620.238533:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758554240:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:3.0:1789061620.239320:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2356:x1875966758554240:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 1157us (6905us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789061620.242257:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00002000:00100000:3.0:1789061620.242297:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff971a75b16d80 x1875966758554240/t4294967305(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:41/0 lens 504/448 e 0 to 0 dl 1789061631 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789061620.242312:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a75b16d80 with x1875966758554240 ext(0->12) 00010000:00010000:3.0:1789061620.242327:0:6707:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 9 pid: 6702 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.243118:0:6707:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 9 pid: 6702 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789061620.243134:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff971a75b16d80 00000100:00100000:0.0:1789061620.250023:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061620.251041:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758554368 00000100:00100000:2.0:1789061620.251060:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758554368 00010000:00010000:2.0:1789061620.251198:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 9 pid: 6702 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061620.251310:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1789061620.251324:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2355:x1875966758554368:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061620.251354:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789061620.251383:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789061620.251387:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789061618 00002000:00010000:2.0:1789061620.251389:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789061619 00002000:00010000:2.0:1789061620.251391:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789061618 00010000:00010000:2.0:1789061620.251399:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 9 pid: 6702 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.251415:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 9 pid: 6702 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.251443:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087562968/0x427fa11dc4a9b109 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a23e expref: 9 pid: 6702 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.251555:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061620.251560:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061620.251567:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.251580:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.251629:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061620.251713:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2355:x1875966758554368:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 392us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061620.251721:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00010000:00010000:3.0:1789061620.251801:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.251822:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.251855:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.251865:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.251899:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.251908:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061620.251913:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.251924:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.251938:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.251946:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b156 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061620.252002:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758554112:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 28228us (29793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061620.252011:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1789061620.259155:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061620.260327:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758554624 00000100:00100000:3.0:1789061620.260358:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758554624 00000100:00100000:3.0:1789061620.260483:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:3.0:1789061620.260588:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a65021850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+25:11371:x1875966758554624:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:3.0:1789061620.261221:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b148 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a25a expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789061620.262299:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1789061620.262375:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1789061620.264682:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1789061620.264827:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.264857:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9b0f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a230 expref: 29 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.264869:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.265406:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9b0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a230 expref: 29 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.265430:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9b0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a230 expref: 29 pid: 8391 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061620.265447:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbff480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1875966779534592:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061620.265621:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061620.273476:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061620.274215:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbff480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1875966779534592:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061620.274255:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061620.274353:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758554752 00000100:00100000:1.0:1789061620.274364:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758554752 00010000:00010000:1.0:1789061620.274978:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9b0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a230 expref: 30 pid: 8391 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061620.275079:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1789061620.275095:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+30:2356:x1875966758554752:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061620.275118:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061620.275126:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9b0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a230 expref: 30 pid: 8391 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.275169:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9b0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a230 expref: 30 pid: 8391 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.275201:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9b0f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a230 expref: 30 pid: 8391 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.275226:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636200) 00010000:00010000:1.0:1789061620.275233:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.275245:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.275255:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.275293:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061620.275393:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+29:2356:x1875966758554752:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 302us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061620.275410:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00010000:00010000:3.0:1789061620.275507:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.275528:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789061620.275721:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789061620.279409:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1789061620.280303:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c9e3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779534720:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789061620.280427:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061620.280686:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779534720 00000100:00100000:3.0:1789061620.280698:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779534720 00000100:00100000:3.0:1789061620.280791:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789061620.280973:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1875966779534720:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1789061620.281100:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061620.281199:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d4780 going to sleep for 11 seconds 00000100:00100000:0.0:1789061620.281954:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1875966779534720:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1150us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061620.281974:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789061620.282056:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c9e3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779534720:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789061620.283267:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1789061620.283935:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779534848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789061620.284015:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061620.284044:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a43c7b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061620.284125:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779534848 00000100:00100000:2.0:1789061620.284135:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779534848 00000100:00100000:2.0:1789061620.284199:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789061620.284210:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875966779534848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789061620.284531:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1875966779534848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 322us (514us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789061620.284541:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789061620.285095:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779534848:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789061620.285215:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1789061620.285281:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.285295:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.285305:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.285312:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061620.285318:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.285327:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.285359:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636200) 00010000:00010000:1.0:1789061620.285363:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789061620.285370:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061620.285377:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b15d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789061620.285983:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789061620.286114:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1789061620.286128:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394527640229ns, next at 395527637174ns, rc = 0 00000001:00080000:1.0:1789061620.286138:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1789061620.286184:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636200) 00010000:00010000:1.0:1789061620.286188:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789061620.286212:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b148 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a25a expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061620.286391:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a65021850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+32:11371:x1875966758554624:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 25877us (27254us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1789061620.289341:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061620.289889:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758554880 00000100:00100000:2.0:1789061620.289905:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758554880 00000100:00100000:2.0:1789061620.289982:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:2.0:1789061620.289997:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+33:11371:x1875966758554880:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061620.290033:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061620.290082:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b164 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a261 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.290168:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a261 expref: 34 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.290187:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a261 expref: 34 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.290211:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:2.0:1789061620.290216:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789061620.290220:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e800, rc 0) 00000100:00100000:2.0:1789061620.290303:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+34:11371:x1875966758554880:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 310us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061620.290311:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:1.0:1789061620.290714:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000020:00080000:1.0:1789061620.290722:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789061620.303125:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061620.303250:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758555136 00000100:00100000:0.0:1789061620.303265:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758555136 00000100:00100000:0.0:1789061620.303414:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:0.0:1789061620.303428:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+33:11371:x1875966758555136:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789061620.304038:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+34:11371:x1875966758555136:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 611us (925us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1789061620.304049:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1789061620.421090:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061620.421238:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758555392 00000100:00100000:2.0:1789061620.421255:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758555392 00000100:00100000:2.0:1789061620.421338:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:2.0:1789061620.421361:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+34:11381:x1875966758555392:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061620.421407:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061620.421437:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b16b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a268 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061620.421610:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789061620.422327:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b16b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a268 expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.422387:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:2.0:1789061620.422400:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061620.422408:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b16b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a268 expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.422430:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e600, rc 0) 00000100:00100000:2.0:1789061620.422773:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+35:11381:x1875966758555392:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1414us (1698us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1789061620.422783:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:2.0:1789061620.434020:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061620.434210:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758555520 00000100:00100000:3.0:1789061620.434234:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758555520 00000100:00100000:3.0:1789061620.434316:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 149 00000100:00100000:3.0:1789061620.434330:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+35:11381:x1875966758555520:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:3.0:1789061620.434457:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b179 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434480:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b179 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434520:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b179 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434540:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b180 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434547:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b180 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434553:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b180 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434673:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434698:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434705:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061620.434761:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434777:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b179 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434784:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b179 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434791:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b179 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434798:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40031400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061620.434803:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b179 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434810:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b179 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434824:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:3.0:1789061620.434827:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061620.434833:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b179 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434839:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b179 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434861:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b180 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434867:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b180 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434873:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b180 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434878:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061620.434881:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b180 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434887:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b180 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434894:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a43636a00) 00010000:00010000:3.0:1789061620.434896:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061620.434899:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b180 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434904:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b180 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434922:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434928:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434933:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434945:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061620.434948:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434954:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434962:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:3.0:1789061620.434964:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061620.434967:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b187 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.434973:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061620.435193:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+35:11381:x1875966758555520:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 865us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061620.435203:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 149 00000100:00100000:0.0:1789061620.437191:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061620.437450:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758555776 00000100:00100000:1.0:1789061620.437463:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758555776 00000100:00100000:1.0:1789061620.437564:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:1.0:1789061620.437576:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+35:11381:x1875966758555776:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1789061620.438288:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+36:11381:x1875966758555776:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 710us (1106us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1789061620.438296:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:1.0:1789061620.532320:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061620.532388:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758556032 00000100:00100000:3.0:1789061620.532402:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758556032 00000100:00100000:3.0:1789061620.532480:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:3.0:1789061620.532522:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+36:11384:x1875966758556032:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061620.532554:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061620.532583:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b18e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a26f expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.532689:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b195 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.532737:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b195 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.532753:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b195 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.532771:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b19c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.532778:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.532785:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535325:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b1a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535368:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535384:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061620.535403:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789061620.535691:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b195 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535701:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b195 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535708:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b195 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535724:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061620.535730:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b195 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535739:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b195 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535756:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:3.0:1789061620.535760:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061620.535766:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b195 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535772:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030000/0x427fa11dc4a9b195 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535790:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535797:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b19c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535804:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b19c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535809:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40031400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061620.535812:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b19c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535819:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b19c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535838:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a43636a00) 00010000:00010000:3.0:1789061620.535841:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061620.535844:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b19c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535850:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031400/0x427fa11dc4a9b19c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535922:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030800/0x427fa11dc4a9b18e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a26f expref: 39 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535943:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a26f expref: 38 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.535951:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:3.0:1789061620.535954:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061620.535957:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042000, rc 0) 00000100:00100000:3.0:1789061620.536076:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11384:x1875966758556032:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 3584us (3770us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1789061620.536088:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:3.0:1789061620.543793:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061620.544532:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758556160 00000100:00100000:0.0:1789061620.544548:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758556160 00000100:00100000:0.0:1789061620.544618:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 151 00000100:00100000:0.0:1789061620.544631:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11384:x1875966758556160:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1789061620.544727:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061620.544750:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061620.544765:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061620.544804:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061620.544812:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061620.544820:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061620.544826:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061620.544833:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061620.544866:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061620.544884:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:0.0:1789061620.544888:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789061620.544895:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061620.544902:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061620.545017:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11384:x1875966758556160:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 388us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061620.545027:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 151 00000001:00080000:0.0:1789061620.547559:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967432 is committed 00000001:00080000:0.0:1789061620.547590:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967434 is committed 00000004:00080000:0.0:1789061620.547597:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789061620.547618:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff971a43c7b9c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789061620.547623:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a64cfc200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff971a43c7b240 00000020:00080000:0.0:1789061620.547626:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a64cfcf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff971a60308c00 00000020:00080000:2.0:1789061620.547677:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789061620.547918:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789061620.548815:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779534976:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789061620.548919:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061620.549164:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779534976 00000100:00100000:3.0:1789061620.549175:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779534976 00000100:00100000:3.0:1789061620.549304:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789061620.549317:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875966779534976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789061620.549366:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1789061620.549414:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa2e9f2, atime: 0x6aa2e9f3, ctime: 0x6aa2e9f2, blocks: 0x1 00010000:00010000:3.0:1789061620.549441:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b1b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.549462:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1789061620.549468:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061620.549476:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b1b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.549525:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b1b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.549536:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b1b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.549545:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b1b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061620.549734:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789061620.549828:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:2.0:1789061620.549961:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061620.549970:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b1b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.549980:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061620.549985:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b1b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.549996:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b1b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.550020:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b1b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.550041:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b1b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061620.550068:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061620.550069:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061620.550071:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061620.550552:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758556416 00000100:00100000:0.0:1789061620.550562:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758556416 00000100:00100000:1.0:1789061620.550632:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:1.0:1789061620.550645:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+18:11384:x1875966758556416:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1789061620.550959:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+19:11384:x1875966758556416:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 316us (1132us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789061620.550967:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:1.0:1789061620.552332:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1875966779534976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3013us (3408us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789061620.552354:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1789061620.552766:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff971a7cbfc380/2, rc 0, transno 4294967307 00000100:00100000:3.0:1789061620.552775:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779534976:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789061620.605845:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061621.012914:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061621.013688:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758556672 00000100:00100000:2.0:1789061621.013704:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758556672 00000100:00080000:0.0:1789061621.013817:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061621.015963:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00100000:2.0:1789061621.015991:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+19:11415:x1875966758556672:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1789061621.016108:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061621.016137:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b1bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a276 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.016274:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b1c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.016551:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.016570:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061621.016586:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789061621.016958:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b1bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a276 expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.017080:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a276 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.017090:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:2.0:1789061621.017093:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061621.017097:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e400, rc 0) 00000100:00100000:2.0:1789061621.017796:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+21:11415:x1875966758556672:12345-192.168.204.54@tcp:101:cat.0 Request processed in 1813us (4896us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789061621.017815:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00100000:2.0:1789061621.022103:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061621.024831:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061621.024990:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758556800 00000100:00100000:3.0:1789061621.025078:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758556800 00000100:00100000:3.0:1789061621.025171:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1789061621.025186:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+21:2355:x1875966758556800:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061621.025211:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061621.025568:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b1c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a276 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061621.025691:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:3.0:1789061621.025698:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061621.025836:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+20:2355:x1875966758556800:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 652us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061621.025845:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1789061621.026450:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758557056 00000100:00100000:1.0:1789061621.026794:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758557056 00000100:00100000:1.0:1789061621.026890:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:1.0:1789061621.026900:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+20:11415:x1875966758557056:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:1.0:1789061621.027410:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+21:11415:x1875966758557056:12345-192.168.204.54@tcp:35:cat.0 Request processed in 509us (5326us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1789061621.027418:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1789061621.122951:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061621.123906:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758557312 00000100:00100000:0.0:1789061621.123922:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758557312 00000100:00100000:0.0:1789061621.124075:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 153 00000100:00100000:0.0:1789061621.124106:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+21:11421:x1875966758557312:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:0.0:1789061621.124139:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061621.124143:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789061621.124176:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b125 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a24c expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.124202:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:0.0:1789061621.124208:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061621.124836:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a27d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.124979:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.125010:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b1a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a26f expref: 21 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.125021:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.125067:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a26f expref: 21 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.125086:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b1a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a26f expref: 21 pid: 8391 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061621.125103:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779535104:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061621.125253:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d4600 going to sleep for 11 seconds 00000100:00100000:0.0:1789061621.130820:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779535104:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789061621.130863:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061621.132052:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061621.132179:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758557440 00000100:00100000:1.0:1789061621.132192:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758557440 00010000:00010000:1.0:1789061621.132250:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b1a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a26f expref: 22 pid: 8391 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061621.132312:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:1.0:1789061621.132323:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c96850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+22:2356:x1875966758557440:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061621.132355:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061621.132364:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b1a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a26f expref: 22 pid: 8391 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.132379:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a26f expref: 22 pid: 8391 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.132406:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b1a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a26f expref: 22 pid: 8391 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.132426:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:1.0:1789061621.132433:0:7648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.132477:0:7648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.132783:0:7648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.132854:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061621.132923:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c96850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+21:2356:x1875966758557440:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 602us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061621.132932:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00010000:00010000:0.0:1789061621.136753:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.136775:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061621.136806:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789061621.137066:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a27d expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.137095:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a27d expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.137106:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:0.0:1789061621.137109:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789061621.137114:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596de00, rc 0) 00000100:00100000:0.0:1789061621.137220:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+21:11421:x1875966758557312:12345-192.168.204.54@tcp:101:dd.0 Request processed in 13116us (14282us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789061621.137240:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 153 00000100:00100000:3.0:1789061621.144943:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061621.145576:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758557696 00000100:00100000:2.0:1789061621.145592:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758557696 00000100:00100000:2.0:1789061621.145680:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 154 00000100:00100000:2.0:1789061621.145693:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+21:11421:x1875966758557696:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:2.0:1789061621.146061:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b1e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.146085:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.146100:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789061621.146161:0:8391:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1789061621.146187:0:8391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028778cde reply state 000000001925474a transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061621.146216:0:8391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061621.146843:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+24:11421:x1875966758557696:12345-192.168.204.54@tcp:36:dd.0 Request processed in 1147us (1910us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789061621.146853:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 154 00000020:00080000:2.0:1789061621.146861:0:8391:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789061621.152390:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.152415:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b1e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.152424:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.152431:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ee00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061621.152437:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.152445:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b1e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.152467:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:1.0:1789061621.152470:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061621.152476:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b1e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.152544:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b1e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061621.502894:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779535232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061621.503011:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061621.503269:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779535232 00000100:00100000:3.0:1789061621.503280:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779535232 00000100:00100000:3.0:1789061621.503361:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789061621.503373:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875966779535232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789061621.503404:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061621.503478:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875966779535232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061621.503525:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789061621.503731:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779535232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061621.507024:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061621.507764:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758557824 00000100:00100000:0.0:1789061621.507780:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758557824 00000100:00100000:0.0:1789061621.507863:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:0.0:1789061621.507875:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+23:11435:x1875966758557824:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:0.0:1789061621.507906:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061621.507952:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a284 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.508050:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b1f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.508067:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b1f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.508080:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b1f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.508096:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b1fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.508102:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b1fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.508107:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b1fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.508856:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b205 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.508876:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a27d expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.508885:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b205 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.508928:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a27d expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.508959:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a27d expref: 24 pid: 5852 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061621.508977:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779535360:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061621.509151:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061621.512617:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061621.513074:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758558080 00000100:00100000:1.0:1789061621.513088:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758558080 00000100:00100000:1.0:1789061621.513221:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1789061621.513235:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+25:5593:x1875966758558080:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789061621.513282:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779535360:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789061621.513316:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b205 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061621.513731:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+26:5593:x1875966758558080:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 499us (1129us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1789061621.513741:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1789061621.516248:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061621.516359:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758558208 00000100:00100000:2.0:1789061621.516381:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758558208 00010000:00010000:2.0:1789061621.516437:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a27d expref: 26 pid: 5852 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061621.516750:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1789061621.516765:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+26:2356:x1875966758558208:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061621.516785:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061621.516793:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a27d expref: 26 pid: 5852 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.516808:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a27d expref: 26 pid: 5852 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.516834:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b1db lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a27d expref: 26 pid: 5852 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.516855:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:2.0:1789061621.516879:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b205 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.516892:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.516901:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b205 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.516938:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061621.517009:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+25:2356:x1875966758558208:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 247us (773us total) trans 0 rc 0/0 00010000:00010000:0.0:1789061621.517058:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517066:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061621.517125:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789061621.517131:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061621.517160:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517175:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517186:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b1f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517193:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b1f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517211:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b1f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517219:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596cc00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061621.517224:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b1f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517232:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b1f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517241:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:0.0:1789061621.517243:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061621.517248:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b1f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517254:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b1f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517266:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b1fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517274:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b1fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517280:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b1fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517284:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596da00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061621.517286:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b1fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517302:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b1fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517310:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a610ee500) 00010000:00010000:0.0:1789061621.517313:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061621.517316:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b1fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517335:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b1fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517397:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b1f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a284 expref: 26 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517413:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b205 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a284 expref: 25 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.517421:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:0.0:1789061621.517423:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061621.517425:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c400, rc 0) 00000100:00100000:0.0:1789061621.517457:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+25:11435:x1875966758557824:12345-192.168.204.54@tcp:101:stat.0 Request processed in 9584us (10448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061621.517465:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:2.0:1789061621.518957:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:3.0:1789061621.584220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061621.584347:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758558464 00000100:00100000:2.0:1789061621.584361:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758558464 00000100:00100000:2.0:1789061621.584433:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:2.0:1789061621.584446:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+24:11441:x1875966758558464:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:2.0:1789061621.584573:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061621.584611:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b205 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a284 expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.584647:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:2.0:1789061621.584655:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061621.584933:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b20c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.584950:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b20c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.584961:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b20c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789061621.585040:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1789061621.585063:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000881aa31a reply state 000000004459770a transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b20c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061621.585074:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061621.585190:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+26:11441:x1875966758558464:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 746us (984us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789061621.585198:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 156 00000020:00080000:2.0:1789061621.585203:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789061621.589144:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b20c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.589168:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b20c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.589176:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b20c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.589182:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fe00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061621.589187:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b20c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.589196:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b20c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.589217:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:2.0:1789061621.589220:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061621.589225:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b20c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.589230:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b20c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.631617:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061621.767116:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061621.767277:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758558592 00000100:00100000:2.0:1789061621.767292:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758558592 00000100:00100000:2.0:1789061621.767384:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:2.0:1789061621.767398:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+25:11454:x1875966758558592:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:2.0:1789061621.767433:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061621.767461:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b213 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a28b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.767611:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b21a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.767639:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b21a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.767656:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b21a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.767676:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.767684:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.767691:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.768445:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b228 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.768471:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.768480:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061621.768988:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789061621.768996:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061621.769021:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769035:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769045:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b21a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769051:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b21a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769057:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b21a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769063:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ee00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061621.769068:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b21a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769076:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b21a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769090:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:2.0:1789061621.769101:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061621.769107:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b21a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769112:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b21a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769127:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769132:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b221 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769137:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769141:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fc00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061621.769143:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769147:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b221 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769153:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a613b5c00) 00010000:00010000:2.0:1789061621.769155:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061621.769157:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b221 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769162:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b221 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769204:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b213 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a28b expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769228:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a28b expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.769234:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:2.0:1789061621.769236:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061621.769239:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e000, rc 0) 00000100:00100000:2.0:1789061621.769343:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+26:11454:x1875966758558592:12345-192.168.204.54@tcp:101:stat.0 Request processed in 1948us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061621.769353:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 157 00000040:00080000:1.0:1789061621.821818:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061621.821830:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061621.822394:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1789061621.822404:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061621.877216:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061621.877331:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758558848 00000100:00100000:2.0:1789061621.877345:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758558848 00000100:00100000:2.0:1789061621.877421:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 158 00000100:00100000:2.0:1789061621.877432:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+26:11465:x1875966758558848:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061621.877458:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061621.877662:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b22f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a292 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061621.877783:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789061621.877946:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b22f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a292 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.877962:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:2.0:1789061621.877965:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061621.877970:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b22f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a292 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061621.878015:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fe00, rc 0) 00000100:00100000:2.0:1789061621.878258:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+27:11465:x1875966758558848:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 827us (1057us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1789061621.878268:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 158 00000100:00100000:1.0:1789061621.896437:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061621.896539:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758559104 00000100:00100000:2.0:1789061621.896554:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758559104 00000100:00100000:2.0:1789061621.896624:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1789061621.896635:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a65023050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+27:11465:x1875966758559104:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789061621.897072:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a65023050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+28:11465:x1875966758559104:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 436us (648us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789061621.897082:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:0.0:1789061621.972430:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061621.972656:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758559360 00000100:00100000:3.0:1789061621.972671:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758559360 00000100:00100000:3.0:1789061621.972747:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:3.0:1789061621.972758:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+28:11471:x1875966758559360:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789061621.972800:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061621.972839:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b23d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a299 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061621.972978:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061621.972996:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b228 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a28b expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061621.973007:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061621.973048:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a28b expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061621.973064:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b228 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a28b expref: 29 pid: 5852 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061621.973081:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779535488:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061621.973196:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde1900 going to sleep for 11 seconds 00000100:00100000:3.0:1789061621.981958:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75cb1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779535488:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061621.981995:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061621.988244:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061621.988354:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758559488 00000100:00100000:1.0:1789061621.988365:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758559488 00010000:00010000:1.0:1789061621.988404:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b228 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a28b expref: 30 pid: 5852 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061621.988443:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:1.0:1789061621.988453:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+30:2355:x1875966758559488:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061621.988467:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061621.988474:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b228 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a28b expref: 30 pid: 5852 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.988543:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a28b expref: 30 pid: 5852 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.988565:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b228 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a28b expref: 30 pid: 5852 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.988582:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:1.0:1789061621.988588:0:7648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.988598:0:7648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.988606:0:7648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.988632:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061621.988698:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+29:2355:x1875966758559488:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 246us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061621.988706:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00010000:00010000:0.0:1789061621.988777:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.988796:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061621.988817:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789061621.989005:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b23d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a299 expref: 30 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.989023:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a299 expref: 29 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061621.989031:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:0.0:1789061621.989034:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789061621.989036:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042600, rc 0) 00000100:00100000:0.0:1789061621.989066:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+29:11471:x1875966758559360:12345-192.168.204.54@tcp:101:bash.0 Request processed in 16311us (16652us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1789061621.989073:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:1.0:1789061621.995205:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061621.995283:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758559744 00000100:00100000:3.0:1789061621.995295:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758559744 00000100:00100000:3.0:1789061621.995364:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00100000:3.0:1789061621.995376:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+29:11471:x1875966758559744:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:3.0:1789061621.995827:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b252 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061621.995854:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061621.995866:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789061621.996814:0:8391:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1789061621.996860:0:8391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0be68de reply state 0000000089e82810 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061621.996870:0:8391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061621.996991:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+32:11471:x1875966758559744:12345-192.168.204.54@tcp:36:bash.0 Request processed in 1615us (1795us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789061621.996999:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 160 00000020:00080000:3.0:1789061621.997004:0:8391:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789061621.998897:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.998925:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b252 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.998933:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.998956:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061621.998961:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.998969:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b252 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.998987:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:1.0:1789061621.998989:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061621.998994:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b252 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061621.998999:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b252 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061622.007927:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061622.008550:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758559872 00000100:00100000:0.0:1789061622.008562:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758559872 00000100:00100000:0.0:1789061622.008629:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 161 00000100:00100000:0.0:1789061622.008639:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+31:11471:x1875966758559872:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789061622.008663:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061622.008684:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b259 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2a0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.008964:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.008999:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a299 expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.009007:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b260 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.009041:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a299 expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.009055:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a299 expref: 32 pid: 5853 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061622.009070:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7c9e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779535616:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061622.009255:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d4600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061622.027116:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061622.027257:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7c9e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779535616:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789061622.027293:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061622.027624:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758560000 00000100:00100000:3.0:1789061622.027640:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758560000 00010000:00010000:3.0:1789061622.027689:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a299 expref: 33 pid: 5853 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061622.027744:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:3.0:1789061622.027756:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+33:2355:x1875966758560000:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061622.027770:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061622.027778:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a299 expref: 33 pid: 5853 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.027793:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a299 expref: 33 pid: 5853 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.027838:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b244 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a299 expref: 33 pid: 5853 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.027854:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:3.0:1789061622.027859:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.027869:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.027878:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b260 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.027971:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061622.028042:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+32:2355:x1875966758560000:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 288us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061622.028050:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00010000:00010000:1.0:1789061622.032808:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061622.032826:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061622.032882:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789061622.032887:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789061622.032910:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061622.032977:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b259 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2a0 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061622.033002:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2a0 expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061622.033011:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:1.0:1789061622.033014:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061622.033018:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596dc00, rc 0) 00000100:00100000:1.0:1789061622.033182:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+31:11471:x1875966758559872:12345-192.168.204.54@tcp:101:bash.0 Request processed in 24541us (25263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061622.033202:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 161 00000100:00100000:2.0:1789061622.039099:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061622.040833:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758560256 00000100:00100000:1.0:1789061622.040854:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758560256 00000100:00100000:1.0:1789061622.041011:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:1.0:1789061622.041024:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+31:11471:x1875966758560256:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:1.0:1789061622.041341:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+32:11471:x1875966758560256:12345-192.168.204.54@tcp:35:bash.0 Request processed in 319us (2256us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1789061622.041349:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:1.0:1789061622.190326:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061622.190594:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758560512 00000100:00100000:2.0:1789061622.190608:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758560512 00000100:00100000:2.0:1789061622.190695:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:2.0:1789061622.190708:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+32:11481:x1875966758560512:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061622.190742:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061622.190768:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b267 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2a7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061622.190891:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789061622.191074:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b267 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2a7 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.191118:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:2.0:1789061622.191122:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061622.191129:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2a7 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.191148:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63ee00, rc 0) 00000100:00100000:2.0:1789061622.191236:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+33:11481:x1875966758560512:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 531us (937us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1789061622.191244:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:0.0:1789061622.198469:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061622.198589:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758560640 00000100:00100000:3.0:1789061622.198604:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758560640 00000100:00100000:3.0:1789061622.198688:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:3.0:1789061622.198701:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+33:11481:x1875966758560640:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:3.0:1789061622.198822:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b275 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.198844:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b275 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.198858:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b275 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.198898:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b27c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.198906:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.198914:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199275:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199285:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199293:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061622.199361:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199377:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b275 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199384:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b275 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199391:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b275 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199398:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061622.199404:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b275 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199420:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b275 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199435:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:3.0:1789061622.199438:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061622.199445:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b275 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199451:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b275 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199466:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199472:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b27c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199477:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b27c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199482:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061622.199485:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b27c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199554:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b27c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199561:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a43636600) 00010000:00010000:3.0:1789061622.199563:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061622.199566:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b27c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199581:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b27c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199599:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199605:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b283 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199611:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199617:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042e00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061622.199620:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199626:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199633:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:3.0:1789061622.199636:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061622.199639:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b283 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.199645:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061622.199759:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+33:11481:x1875966758560640:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1059us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061622.199769:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:1.0:1789061622.203110:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061622.203256:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758560896 00000100:00100000:2.0:1789061622.203270:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758560896 00000100:00100000:2.0:1789061622.203343:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:2.0:1789061622.203354:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+33:11481:x1875966758560896:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789061622.203706:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+34:11481:x1875966758560896:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 353us (611us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789061622.203715:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:2.0:1789061622.256694:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061622.257456:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758561152 00000100:00100000:3.0:1789061622.257471:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758561152 00000100:00100000:2.0:1789061622.257762:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:2.0:1789061622.257788:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+34:11484:x1875966758561152:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061622.257826:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061622.257857:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b28a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2ae expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.258236:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b291 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.258277:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b291 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.258291:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b291 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.258324:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.258332:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.258339:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.258818:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b29f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.258830:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b29f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.258839:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b29f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061622.258851:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789061622.259159:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b291 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259170:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b291 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259177:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b291 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259191:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061622.259197:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b291 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259206:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b291 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259222:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:2.0:1789061622.259225:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061622.259231:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b291 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259238:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b291 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259257:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259263:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b298 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259270:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259275:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061622.259278:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259284:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259303:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a613b5c00) 00010000:00010000:2.0:1789061622.259316:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061622.259321:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b298 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259327:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b298 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259391:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b28a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ae expref: 37 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259409:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b29f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ae expref: 36 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.259418:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:2.0:1789061622.259421:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061622.259423:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63ee00, rc 0) 00000100:00100000:2.0:1789061622.259635:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+36:11484:x1875966758561152:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1851us (2956us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789061622.259645:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:0.0:1789061622.263110:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061622.263195:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758561280 00000100:00100000:3.0:1789061622.263208:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758561280 00000100:00100000:3.0:1789061622.263280:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:3.0:1789061622.263291:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+36:11484:x1875966758561280:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1789061622.263406:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b2ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.263427:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b2ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.263443:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b2ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.263477:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b2ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.263533:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b2ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.263544:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b2ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.263550:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042e00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061622.263556:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b2ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.263564:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b2ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.263578:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:3.0:1789061622.263598:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789061622.263605:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b2ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.263613:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b2ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061622.263710:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+36:11484:x1875966758561280:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 420us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061622.263717:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:1.0:1789061622.268027:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061622.272859:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758561536 00000100:00100000:2.0:1789061622.272881:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758561536 00000100:00100000:2.0:1789061622.272974:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:2.0:1789061622.272987:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+36:11484:x1875966758561536:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789061622.273318:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+37:11484:x1875966758561536:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 321us (5294us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789061622.273327:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:2.0:1789061622.276894:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061622.279839:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758561664 00000100:00100000:1.0:1789061622.279860:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758561664 00000100:00100000:1.0:1789061622.279973:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1789061622.279986:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+37:2353:x1875966758561664:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061622.280027:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061622.280062:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b29f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ae expref: 37 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061622.280088:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:1.0:1789061622.280095:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061622.280183:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+36:2353:x1875966758561664:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 201us (3307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061622.280192:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1789061622.455627:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061622.457237:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758561920 00000100:00100000:3.0:1789061622.457336:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758561920 00000100:00100000:3.0:1789061622.457547:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:3.0:1789061622.457561:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+36:11502:x1875966758561920:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1789061622.457597:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061622.457626:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b2b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2b5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.458233:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b2bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.458257:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b2bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.458481:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b2bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061622.458520:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789061622.459337:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b2b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2b5 expref: 39 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.459375:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b2bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2b5 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.459387:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:2.0:1789061622.459391:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789061622.459396:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042400, rc 0) 00000100:00100000:2.0:1789061622.459537:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11502:x1875966758561920:12345-192.168.204.54@tcp:101:cat.0 Request processed in 1931us (3876us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789061622.459548:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:2.0:1789061622.493046:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061622.493213:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758562048 00000100:00100000:3.0:1789061622.493227:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758562048 00000100:00100000:3.0:1789061622.493315:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:3.0:1789061622.493346:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11503:x1875966758562048:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061622.493386:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061622.493414:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b2c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2bc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.493559:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b2d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.493578:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.493592:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061622.493789:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789061622.493795:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789061622.493819:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.493852:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b2c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2bc expref: 40 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.493877:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b2d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2bc expref: 39 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.493887:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:3.0:1789061622.493891:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789061622.493896:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042000, rc 0) 00000100:00100000:3.0:1789061622.493970:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+39:11503:x1875966758562048:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 627us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061622.493991:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:1.0:1789061622.500907:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061622.501007:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758562432 00000100:00100000:2.0:1789061622.501021:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758562432 00000100:00100000:2.0:1789061622.501092:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:2.0:1789061622.501105:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+39:11503:x1875966758562432:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789061622.501601:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+40:11503:x1875966758562432:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 497us (707us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789061622.501610:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:0.0:1789061622.505295:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061622.505351:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061622.505398:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061622.505432:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061622.505467:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758562688 00000100:00100000:0.0:1789061622.505480:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758562688 00000100:00100000:2.0:1789061622.505613:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758562944 00000100:00100000:2.0:1789061622.505627:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758562944 00000100:00100000:2.0:1789061622.505704:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00100000:2.0:1789061622.505717:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758562944:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061622.505819:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758562944:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 104us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061622.505846:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00080000:2.0:1789061622.505912:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061622.506044:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758562560 00000100:00100000:1.0:1789061622.506049:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758562560 00000100:00100000:1.0:1789061622.506091:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 301 00000100:00100000:1.0:1789061622.506099:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758562560:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061622.506131:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758562560:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 33us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061622.506138:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 301 00000100:00100000:1.0:1789061622.506204:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061622.506371:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758563072 00000100:00100000:1.0:1789061622.506375:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758563072 00000100:00100000:1.0:1789061622.506414:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:1.0:1789061622.506421:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c604000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+40:11503:x1875966758563072:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:1.0:1789061622.506433:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789061622.506463:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b260 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2a0 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061622.506541:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b2bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2b5 expref: 39 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061622.506556:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b164 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a261 expref: 38 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061622.506568:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5e00) 00010000:00010000:1.0:1789061622.506582:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061622.506611:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c604000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+37:11503:x1875966758563072:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 190us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061622.506624:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789061622.509025:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758562816 00000100:00100000:0.0:1789061622.509041:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758562816 00000100:00100000:0.0:1789061622.509077:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:0.0:1789061622.509088:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758562688:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061622.509207:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758562688:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 122us (3927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061622.509216:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:0.0:1789061622.509235:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:0.0:1789061622.509241:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758562816:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061622.509267:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2356:x1875966758562816:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (3835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061622.509274:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00080000:1.0:1789061622.511192:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061622.511207:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061622.514452:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061622.514574:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758563200 00000100:00100000:3.0:1789061622.514588:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758563200 00000100:00100000:3.0:1789061622.514674:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:3.0:1789061622.514687:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+37:11503:x1875966758563200:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:3.0:1789061622.514862:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b2d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.514883:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b2d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.514898:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b2d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789061622.515298:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789061622.515431:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+37:11503:x1875966758563200:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 746us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061622.515441:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:0.0:1789061622.544783:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061622.544895:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758563328 00000100:00100000:2.0:1789061622.544910:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758563328 00000100:00100000:2.0:1789061622.544991:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:2.0:1789061622.545003:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+37:11505:x1875966758563328:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061622.545033:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061622.545061:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b2de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2c3 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545181:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b2e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545200:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b2e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545215:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b2e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545232:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545240:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545248:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545701:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b2f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545722:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545731:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061622.545778:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789061622.545783:0:8391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061622.545805:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545819:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545829:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b2e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545837:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b2e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545844:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b2e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545850:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061622.545855:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b2e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545864:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b2e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545878:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:2.0:1789061622.545881:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061622.545893:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b2e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545900:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b2e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545918:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545925:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545931:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545937:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fe00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061622.545939:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545945:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545952:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a613b5c00) 00010000:00010000:2.0:1789061622.545954:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061622.545956:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.545962:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.546001:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b2de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2c3 expref: 39 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.546031:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b2f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2c3 expref: 38 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.546039:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636600) 00010000:00010000:2.0:1789061622.546041:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061622.546044:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f400, rc 0) 00000100:00100000:2.0:1789061622.546118:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11505:x1875966758563328:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1118us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061622.546128:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 169 00010000:00010000:1.0:1789061622.653732:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789061622.846800:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789061622.846811:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789061622.846897:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789061622.846906:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061622.847072:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7613ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1875966779535744:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789061622.847203:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a523983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061622.856620:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7613ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1875966779535744:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789061622.866729:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061622.866820:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758563456 00000100:00100000:3.0:1789061622.866834:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758563456 00000100:00100000:3.0:1789061622.866912:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:3.0:1789061622.866925:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11516:x1875966758563456:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789061622.867061:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789061622.867313:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11516:x1875966758563456:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 391us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061622.867331:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:0.0:1789061622.897821:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061622.898160:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758563584 00000100:00100000:2.0:1789061622.898173:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758563584 00000100:00100000:2.0:1789061622.898250:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:2.0:1789061622.898264:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11516:x1875966758563584:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789061622.899390:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2fa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.899484:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900124:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900147:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b301 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900156:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b301 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900163:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b301 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900201:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900209:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900215:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061622.900269:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789061622.900275:0:8391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061622.900292:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900321:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900327:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2fa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900347:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900353:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fe00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061622.900358:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900368:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2fa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900384:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee800) 00010000:00010000:2.0:1789061622.900387:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061622.900394:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900401:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b2fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900732:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b301 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900740:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b301 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900746:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b301 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900752:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061622.900756:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b301 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900773:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b301 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900781:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff971a613b5c00) 00010000:00010000:2.0:1789061622.900784:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061622.900787:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b301 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900793:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b301 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900812:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900818:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b308 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900823:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900828:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061622.900831:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900837:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b308 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900843:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636600) 00010000:00010000:2.0:1789061622.900846:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061622.900849:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b308 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.900865:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061622.902847:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11516:x1875966758563584:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 4568us (5022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061622.902865:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:1.0:1789061622.914411:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061622.914739:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758563840 00000100:00100000:0.0:1789061622.914753:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758563840 00000100:00100000:0.0:1789061622.914828:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:0.0:1789061622.914839:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11516:x1875966758563840:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789061622.914867:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061622.914893:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b30f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2ca expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.915320:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b316 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.915341:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.915398:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061622.915796:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789061622.915930:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.915939:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b316 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.915946:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.915952:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596de00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061622.915956:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.915965:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b316 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.915980:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636600) 00010000:00010000:0.0:1789061622.915984:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061622.915990:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b316 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.915997:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b316 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.916382:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b30f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ca expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.916395:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee800) 00010000:00010000:0.0:1789061622.916398:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789061622.916413:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b30f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ca expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061622.916694:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c400, rc 0) 00000100:00100000:0.0:1789061622.916843:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+39:11516:x1875966758563840:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2003us (2444us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1789061622.916854:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:1.0:1789061622.923287:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061622.923534:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758563968 00000100:00100000:2.0:1789061622.923548:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758563968 00000100:00100000:2.0:1789061622.923630:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:2.0:1789061622.923643:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+39:11516:x1875966758563968:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789061622.923692:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789061622.923837:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+39:11516:x1875966758563968:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 198us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061622.923847:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:1.0:1789061622.928988:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061622.929107:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758564224 00000100:00100000:3.0:1789061622.929139:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758564224 00000100:00100000:3.0:1789061622.929223:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:3.0:1789061622.929234:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+39:11516:x1875966758564224:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061622.929262:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061622.929266:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789061622.929313:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b2d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2bc expref: 39 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.929338:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:3.0:1789061622.929345:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061622.929361:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b324 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2d1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789061622.930410:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789061622.932244:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b32b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.932275:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b32b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.932291:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b32b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.932721:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b324 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2d1 expref: 41 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.932746:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b32b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2d1 expref: 40 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.932775:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff971a43636500) 00010000:00010000:3.0:1789061622.932778:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061622.932783:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042400, rc 0) 00000100:00100000:3.0:1789061622.934921:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+40:11516:x1875966758564224:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 5670us (5932us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789061622.934938:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:1.0:1789061622.939988:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061622.940119:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758564480 00000100:00100000:2.0:1789061622.940134:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758564480 00000100:00100000:2.0:1789061622.940203:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:2.0:1789061622.940216:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+40:11516:x1875966758564480:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789061622.940308:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061622.940356:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b32b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2d1 expref: 40 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940381:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff971a43636500) 00010000:00010000:2.0:1789061622.940399:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061622.940434:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b339 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940474:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940518:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940541:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b340 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe52e1e32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940549:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe52e1e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940556:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe52e1e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940833:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940842:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b339 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940850:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b339 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940857:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061622.940863:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b339 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940872:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b339 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940881:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:2.0:1789061622.940890:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061622.940895:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b339 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940901:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b339 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940913:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe52e1e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940919:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b340 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe52e1e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940924:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe52e1e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940929:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061622.940932:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe52e1e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940937:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b340 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe52e1e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940943:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe52e1e32 (ffff971a613b5c00) 00010000:00010000:2.0:1789061622.940945:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061622.940948:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b340 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe52e1e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.940953:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b340 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe52e1e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061622.941065:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+39:11516:x1875966758564480:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 850us (1092us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789061622.941080:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:1.0:1789061622.944086:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061622.944388:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758564608 00000100:00100000:2.0:1789061622.944402:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758564608 00000100:00100000:2.0:1789061622.944525:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:2.0:1789061622.944539:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+39:11516:x1875966758564608:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061622.944566:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061622.944596:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b347 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2d8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.944652:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b34e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.944669:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b34e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.944685:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b34e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.944818:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2d8 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.944842:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b34e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2d8 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.944851:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff971a613b5400) 00010000:00010000:2.0:1789061622.944854:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789061622.944859:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63ee00, rc 0) 00000100:00100000:2.0:1789061622.944940:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+40:11516:x1875966758564608:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 405us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061622.944954:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:0.0:1789061622.952978:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061622.959125:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758564864 00000100:00100000:2.0:1789061622.959149:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758564864 00000100:00100000:2.0:1789061622.959272:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:2.0:1789061622.959285:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+40:11516:x1875966758564864:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789061622.959424:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b355 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.959447:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.959463:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789061622.960173:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1789061622.960189:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397201700658ns, next at 398201697150ns, rc = 0 00000004:00010000:2.0:1789061622.960318:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2930f33 reply state 000000007d5f7eb5 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061622.960330:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061622.960721:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+42:11516:x1875966758564864:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1436us (7754us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789061622.960732:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 177 00010000:00010000:2.0:1789061622.970872:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.970897:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b355 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.970928:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b355 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.970936:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061622.970942:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b355 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.970952:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b355 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.970974:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff971a613b5400) 00010000:00010000:2.0:1789061622.970978:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789061622.970984:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b355 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.970991:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b355 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061622.971236:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061622.971392:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758564992 00000100:00100000:2.0:1789061622.971406:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758564992 00000100:00100000:2.0:1789061622.971478:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:2.0:1789061622.971513:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+41:11516:x1875966758564992:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061622.971545:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061622.971567:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b35c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2df expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.971656:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b35c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2df expref: 42 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.971688:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b35c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2df expref: 42 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061622.971711:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff971a613b5400) 00010000:00010000:2.0:1789061622.971714:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789061622.971717:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fc00, rc 0) 00000100:00100000:2.0:1789061622.971794:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+42:11516:x1875966758564992:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 305us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061622.971802:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:0.0:1789061622.976165:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061622.976270:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758565120 00000100:00100000:3.0:1789061622.976283:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758565120 00000100:00100000:3.0:1789061622.976452:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1789061622.976465:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2354:x1875966758565120:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789061622.977212:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2354:x1875966758565120:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 746us (1056us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789061622.977221:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:0.0:1789061622.980992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061622.981156:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758565376 00000100:00100000:2.0:1789061622.981170:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758565376 00000100:00100000:2.0:1789061622.981272:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1789061622.981285:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+42:11516:x1875966758565376:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789061622.981678:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+43:11516:x1875966758565376:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 394us (701us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789061622.981687:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:3.0:1789061622.983955:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061622.984068:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758565632 00000100:00100000:0.0:1789061622.984081:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758565632 00000100:00100000:0.0:1789061622.984142:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 179 00000100:00100000:0.0:1789061622.984153:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+43:11516:x1875966758565632:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789061622.984282:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+43:11516:x1875966758565632:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 131us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061622.984290:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 179 00000100:00100000:0.0:1789061622.987329:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061622.987467:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758565760 00000100:00100000:3.0:1789061622.987480:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758565760 00000100:00100000:3.0:1789061622.987568:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 180 00000100:00100000:3.0:1789061622.987581:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+43:11516:x1875966758565760:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061622.987617:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061622.987646:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b363 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2e6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.987742:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b36a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.987783:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b36a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.987797:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b36a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061622.987846:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789061622.987869:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b36a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.987902:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b363 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2e6 expref: 45 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.987923:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b36a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2e6 expref: 44 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061622.987932:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff971a613b5400) 00010000:00010000:3.0:1789061622.987935:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789061622.987939:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042000, rc 0) 00000100:00100000:3.0:1789061622.988009:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+44:11516:x1875966758565760:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 431us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061622.988016:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 180 00000100:00100000:0.0:1789061622.991616:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061622.991777:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758565888 00000100:00100000:1.0:1789061622.991790:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758565888 00000100:00100000:1.0:1789061622.991857:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:1.0:1789061622.991870:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2353:x1875966758565888:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061622.991916:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061622.991944:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004adb2556/0x427fa11dc4a9b371 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2ed expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061622.991979:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2e9f5, blocks: 0x1 00010000:00010000:1.0:1789061622.992009:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1789061622.992015:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061622.992027:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004adb2556/0x427fa11dc4a9b371 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ed expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061622.992050:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004adb2556/0x427fa11dc4a9b371 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ed expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061622.992079:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524e00, rc 0) 00000100:00100000:1.0:1789061622.992148:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2353:x1875966758565888:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 282us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061622.992155:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1789061623.000147:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061623.000267:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758566144 00000100:00100000:0.0:1789061623.000281:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758566144 00000100:00100000:0.0:1789061623.000464:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:0.0:1789061623.000478:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+44:11516:x1875966758566144:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789061623.000661:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+44:11516:x1875966758566144:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 187us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061623.000670:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:0.0:1789061623.005529:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.005647:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758566272 00000100:00100000:1.0:1789061623.005661:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758566272 00000100:00100000:1.0:1789061623.005731:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:1.0:1789061623.005745:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:11516:x1875966758566272:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061623.005770:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061623.005796:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000819ffd3e/0x427fa11dc4a9b378 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2f4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.005841:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004adb2556/0x427fa11dc4a9b371 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ed expref: 9 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.005861:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061623.005867:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061623.005874:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819ffd3e/0x427fa11dc4a9b378 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2f4 expref: 9 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.005924:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004adb2556/0x427fa11dc4a9b371 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ed expref: 9 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.005942:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004adb2556/0x427fa11dc4a9b371 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ed expref: 9 pid: 6701 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061623.005961:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75867b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1875966779535872:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061623.006117:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a436fc600 going to sleep for 11 seconds 00000100:00100000:1.0:1789061623.009619:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061623.009688:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75867b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1875966779535872:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061623.009738:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000819ffd3e/0x427fa11dc4a9b378 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2f4 expref: 9 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.009769:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525200, rc 0) 00000100:00100000:2.0:1789061623.009856:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+9:11516:x1875966758566272:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 4113us (4371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061623.009867:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:3.0:1789061623.009895:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758566400 00000100:00100000:3.0:1789061623.009905:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758566400 00010000:00010000:3.0:1789061623.009949:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004adb2556/0x427fa11dc4a9b371 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ed expref: 9 pid: 6701 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061623.010001:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:3.0:1789061623.010013:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75866d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2355:x1875966758566400:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061623.010031:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061623.010069:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004adb2556/0x427fa11dc4a9b371 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ed expref: 9 pid: 6701 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.010084:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004adb2556/0x427fa11dc4a9b371 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ed expref: 9 pid: 6701 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.010111:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004adb2556/0x427fa11dc4a9b371 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2ed expref: 9 pid: 6701 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.010127:0:7648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061623.010132:0:7648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061623.010141:0:7648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000819ffd3e/0x427fa11dc4a9b378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2f4 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.010152:0:7648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819ffd3e/0x427fa11dc4a9b378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2f4 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.010198:0:7648:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000819ffd3e/0x427fa11dc4a9b378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2f4 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061623.010217:0:7648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7648:1875966779536000:192.168.204.54@tcp:105: 00000100:00100000:3.0:1789061623.010305:0:7648:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061623.019457:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061623.019615:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758566528 00000100:00100000:0.0:1789061623.019628:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758566528 00002000:00100000:0.0:1789061623.019700:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff971a7613ce00 x1875966758566528/t0(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:44/0 lens 504/0 e 0 to 0 dl 1789061634 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061623.019713:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a7613ce00 with x1875966758566528 ext(0->8) 00002000:00010000:0.0:1789061623.019721:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971a7613ce00 00000100:00100000:0.0:1789061623.019761:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1789061623.019773:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2356:x1875966758566528:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789061623.020364:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+11:2356:x1875966758566528:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 591us (918us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789061623.020373:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00002000:00100000:0.0:1789061623.020382:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff971a7613ce00 x1875966758566528/t4294967314(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:44/0 lens 504/448 e 0 to 0 dl 1789061634 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061623.020391:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a7613ce00 with x1875966758566528 ext(0->8) 00002000:00010000:0.0:1789061623.020396:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971a7613ce00 00000100:00100000:3.0:1789061623.023057:0:7648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7648:1875966779536000:192.168.204.54@tcp:105: 00010000:00010000:3.0:1789061623.023095:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061623.031788:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75866d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+10:2355:x1875966758566400:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 21756us (22170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061623.031807:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:0.0:1789061623.040420:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061623.040565:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758566656 00000100:00100000:3.0:1789061623.040579:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758566656 00000100:00100000:3.0:1789061623.040677:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 182 00000100:00100000:3.0:1789061623.040693:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+44:11516:x1875966758566656:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000100:00080000:1.0:1789061623.040841:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061623.099399:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+44:11516:x1875966758566656:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 58692us (58976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061623.099416:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 182 00000001:00080000:3.0:1789061623.099587:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:3.0:1789061623.099622:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1789061623.099631:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:0.0:1789061623.099833:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779536128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789061623.099905:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061623.099993:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779536128 00000100:00100000:0.0:1789061623.100002:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779536128 00000100:00100000:0.0:1789061623.100061:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789061623.100072:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779536128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789061623.100272:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789061623.100276:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789061621 00000020:00080000:3.0:1789061623.100285:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00002000:00010000:0.0:1789061623.100286:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789061623.100289:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789061621 -> 1789061621 00002000:00010000:0.0:1789061623.100302:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000020:00080000:3.0:1789061623.100340:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1789061623.100352:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789061623.100354:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875966779536128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 273us (438us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789061623.100362:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789061623.100381:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789061623.100422:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff971945e5ea00/2, rc 0, transno 4294967315 00000100:00100000:0.0:1789061623.100428:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779536128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789061623.104217:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061623.104413:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758566784 00000100:00100000:0.0:1789061623.104427:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758566784 00000100:00100000:0.0:1789061623.104577:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:0.0:1789061623.104590:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+10:2355:x1875966758566784:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789061623.132813:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1789061623.132836:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1789061623.133004:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2355:x1875966758566784:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 28407us (28792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061623.133019:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:0.0:1789061623.136232:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061623.137608:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758567040 00000100:00100000:2.0:1789061623.137626:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758567040 00000100:00100000:2.0:1789061623.137701:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 183 00000100:00100000:2.0:1789061623.137714:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+18:11516:x1875966758567040:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789061623.137789:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061623.137825:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b36a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2e6 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.137849:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff971a613b5400) 00010000:00010000:2.0:1789061623.137856:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061623.137895:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b37f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.137911:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b37f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.137923:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b37f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061623.138252:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7b21c9a reply state 000000004bcdcc79 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b37f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061623.138263:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061623.138407:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+19:11516:x1875966758567040:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 695us (2188us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789061623.138415:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 183 00010000:00010000:3.0:1789061623.144048:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b37f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.144119:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b37f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.144129:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b37f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.144136:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061623.144142:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b37f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.144164:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b37f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.144187:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff971a613b5400) 00010000:00010000:3.0:1789061623.144190:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061623.144196:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b37f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.144202:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b37f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061623.145337:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.145464:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758567168 00000100:00100000:1.0:1789061623.145478:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758567168 00000100:00100000:1.0:1789061623.145589:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1789061623.145601:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758567168:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789061623.145951:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789061623.145955:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789061621 -> 1789061620 00002000:00010000:1.0:1789061623.145957:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789061619 00002000:00010000:1.0:1789061623.145959:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789061621 -> 1789061620 00002000:00010000:1.0:1789061623.145962:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789061623.146046:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758567168:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 447us (720us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789061623.146055:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:0.0:1789061623.162220:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.162803:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758567424 00000100:00100000:1.0:1789061623.162819:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758567424 00000100:00100000:0.0:1789061623.162974:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00100000:0.0:1789061623.162987:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+18:11516:x1875966758567424:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789061623.163091:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.163111:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b34e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2d8 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.163122:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.163185:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b34e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2d8 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.163201:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b34e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2d8 expref: 18 pid: 5852 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061623.163217:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945e5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1875966779536256:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061623.163363:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061623.166416:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945e5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1875966779536256:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061623.166458:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061623.167813:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.167877:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758567552 00000100:00100000:1.0:1789061623.167889:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758567552 00010000:00010000:1.0:1789061623.167939:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b34e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2d8 expref: 19 pid: 5852 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061623.167990:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1789061623.168001:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+19:2355:x1875966758567552:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061623.168020:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061623.168029:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b34e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2d8 expref: 19 pid: 5852 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.168042:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b34e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2d8 expref: 19 pid: 5852 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.168069:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b34e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2d8 expref: 19 pid: 5852 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.168104:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff971a613b5400) 00010000:00010000:1.0:1789061623.168110:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.168122:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.168131:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.168208:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061623.168214:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.168222:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.168260:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.168267:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.168275:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.168283:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061623.168301:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061623.168301:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+18:2355:x1875966758567552:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 289us (690us total) trans 0 rc 0/0 00010000:00010000:2.0:1789061623.168310:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061623.168310:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00010000:00010000:2.0:1789061623.168319:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff971a613b5400) 00010000:00010000:2.0:1789061623.168322:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789061623.168327:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.168332:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b386 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061623.168377:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+17:11516:x1875966758567424:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 5394us (6174us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789061623.168393:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00100000:0.0:1789061623.171471:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061623.171934:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758567680 00000100:00100000:2.0:1789061623.171951:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758567680 00000100:00100000:2.0:1789061623.172028:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1789061623.172039:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2354:x1875966758567680:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789061623.172116:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.172142:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000819ffd3e/0x427fa11dc4a9b378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2f4 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.172152:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061623.172157:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061623.172163:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.172209:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000819ffd3e/0x427fa11dc4a9b378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2f4 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.172227:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000819ffd3e/0x427fa11dc4a9b378 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2f4 expref: 8 pid: 6702 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061623.172246:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1875966779536384:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061623.172387:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a52398000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061623.179266:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061623.180991:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758567808 00000100:00100000:3.0:1789061623.181011:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758567808 00010000:00010000:3.0:1789061623.181089:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000819ffd3e/0x427fa11dc4a9b378 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2f4 expref: 9 pid: 6702 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061623.181147:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:3.0:1789061623.181159:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2355:x1875966758567808:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061623.181179:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061623.181208:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000819ffd3e/0x427fa11dc4a9b378 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2f4 expref: 9 pid: 6702 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.181224:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000819ffd3e/0x427fa11dc4a9b378 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2f4 expref: 9 pid: 6702 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.181257:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061623.181263:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061623.181299:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.181312:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.181339:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061623.181462:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000819ffd3e/0x427fa11dc4a9b378 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2f4 expref: 9 pid: 6702 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061623.181509:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1875966779536384:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061623.181540:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.181553:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.181576:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.181618:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.181630:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.181648:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061623.181654:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2355:x1875966758567808:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 493us (2399us total) trans 0 rc 0/0 00010000:00010000:2.0:1789061623.181664:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e800 already unused, calling callback (ffffffffc14298b0) 00000100:00100000:3.0:1789061623.181670:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00010000:00010000:2.0:1789061623.181672:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.181684:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.181706:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.181716:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9b38d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061623.181782:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2354:x1875966758567680:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 9745us (10326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061623.181790:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:3.0:1789061623.185859:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061623.185995:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758568064 00000100:00100000:2.0:1789061623.186011:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758568064 00000100:00100000:2.0:1789061623.186095:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:2.0:1789061623.186108:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+17:11516:x1875966758568064:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789061623.186224:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b394 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.186247:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.186262:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.186591:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.186606:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b35c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2df expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.186640:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.186684:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b35c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2df expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.186707:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b35c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2df expref: 18 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061623.186727:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d196a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779536512:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061623.187113:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a52398000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061623.190339:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061623.190429:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758568192 00000100:00100000:2.0:1789061623.190442:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758568192 00010000:00010000:2.0:1789061623.190676:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b35c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2df expref: 19 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061623.190829:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:0.0:1789061623.190842:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+19:2355:x1875966758568192:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061623.190864:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061623.190873:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b35c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2df expref: 19 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.190889:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b35c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2df expref: 19 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.190916:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff971a613b5400) 00010000:00010000:0.0:1789061623.190922:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.190954:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.190963:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.190994:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061623.191044:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b35c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2df expref: 19 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061623.191068:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d196a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779536512:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061623.191075:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+18:2355:x1875966758568192:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 235us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061623.191085:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00010000:00010000:3.0:1789061623.191099:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.191109:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.191114:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789061623.191437:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1789061623.191650:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789061623.191716:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1789061623.191829:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1875966779536640:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789061623.191894:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061623.191937:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789061623.191959:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779536640 00000100:00100000:2.0:1789061623.191968:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779536640 00000100:00100000:2.0:1789061623.192020:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789061623.192030:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875966779536640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789061623.192123:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875966779536640:12345-0@lo:1000:mdt00_001.0 Request processed in 94us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061623.192131:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789061623.192170:0:5852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1789061623.192178:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff971945e5ea00, transno 4294967315 00000100:00100000:3.0:1789061623.192201:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1875966779536640:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789061623.192742:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1789061623.192827:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1875966779536768:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789061623.192881:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061623.192912:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789061623.192950:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779536768 00000100:00100000:1.0:1789061623.192957:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779536768 00000100:00100000:1.0:1789061623.193002:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789061623.193011:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1875966779536768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789061623.193198:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1875966779536768:12345-0@lo:1000:mdt00_001.0 Request processed in 188us (317us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789061623.193207:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789061623.193236:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1875966779536768:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789061623.193270:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193280:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193302:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193309:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061623.193314:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193322:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193340:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff971a613b5400) 00010000:00010000:3.0:1789061623.193343:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061623.193349:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193355:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b39b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193400:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b2d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193406:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b2d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193412:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b2d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193416:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061623.193419:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b2d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193425:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b2d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193433:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636600) 00010000:00010000:3.0:1789061623.193435:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061623.193439:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b2d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193445:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b2d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193468:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193531:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b2f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2c3 expref: 21 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193543:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193583:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b2f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2c3 expref: 21 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.193600:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b2f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2c3 expref: 21 pid: 8391 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061623.193612:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cded80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779536896:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061623.193783:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde1780 going to sleep for 11 seconds 00000100:00100000:0.0:1789061623.196537:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061623.196569:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cded80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779536896:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061623.196615:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061623.196780:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758568320 00000100:00100000:1.0:1789061623.196790:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758568320 00010000:00010000:1.0:1789061623.196841:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b2f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2c3 expref: 22 pid: 8391 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061623.196882:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:1.0:1789061623.196890:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+22:2356:x1875966758568320:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061623.196915:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061623.196922:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b2f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2c3 expref: 22 pid: 8391 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.196932:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b2f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2c3 expref: 22 pid: 8391 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.196956:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b2f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2c3 expref: 22 pid: 8391 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.196974:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636600) 00010000:00010000:1.0:1789061623.196979:0:7648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.196991:0:7648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.197000:0:7648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.197104:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061623.197147:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.197155:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.197170:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061623.197172:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+21:2356:x1875966758568320:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 283us (700us total) trans 0 rc 0/0 00010000:00010000:2.0:1789061623.197178:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061623.197181:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00010000:00010000:2.0:1789061623.197185:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.197192:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061623.197197:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.197205:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.197216:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636600) 00010000:00010000:2.0:1789061623.197219:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061623.197224:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.197231:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b3a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.197249:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.197262:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b394 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.197268:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.197274:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061623.197277:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.197283:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b394 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.197303:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a43636600) 00010000:00010000:2.0:1789061623.197306:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789061623.197309:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b394 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.197314:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b394 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061623.197603:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+20:11516:x1875966758568064:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 11497us (11760us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789061623.197614:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 185 00000020:00080000:2.0:1789061623.197618:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789061623.199265:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061623.199275:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061623.200120:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1789061623.200138:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789061623.200380:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.200480:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758568576 00000100:00100000:1.0:1789061623.200686:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758568576 00000100:00100000:1.0:1789061623.200768:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:1.0:1789061623.200783:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a65020050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+20:11516:x1875966758568576:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789061623.201711:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789061623.201843:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1789061623.201904:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b3a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.201926:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b3a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.201941:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b3a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.201952:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b3a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.201959:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b3a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.201966:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b3a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.201995:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789061623.202122:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a65020050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+22:11516:x1875966758568576:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 1341us (1745us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789061623.202134:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000020:00080000:1.0:1789061623.202141:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789061623.202622:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061623.202632:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b3a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.202641:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524200 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061623.202659:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b3a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.202669:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b3a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.202696:0:8476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff971a6af68100) 00010000:00010000:2.0:1789061623.202700:0:8476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789061623.202705:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b3a9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.202711:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b3a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.202730:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061623.202732:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061623.202734:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789061623.396914:0:12433:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061623.396929:0:12433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789061623.396976:0:12433:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789061623.396984:0:12433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789061623.510611:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.510814:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758568832 00000100:00100000:1.0:1789061623.510828:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758568832 00000100:00100000:1.0:1789061623.510901:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00100000:1.0:1789061623.510923:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+22:11526:x1875966758568832:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789061623.510955:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061623.510982:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b3b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a2fb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.511124:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b3b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.511145:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.511161:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061623.511176:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789061623.511349:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b3b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2fb expref: 25 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.511368:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b3b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2fb expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.511377:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:1.0:1789061623.511380:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789061623.511385:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525e00, rc 0) 00000100:00100000:1.0:1789061623.511455:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+24:11526:x1875966758568832:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 536us (860us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1789061623.511463:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00100000:2.0:1789061623.520022:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061623.523726:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758568960 00000100:00100000:0.0:1789061623.523756:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758568960 00000100:00100000:2.0:1789061623.526348:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00100000:2.0:1789061623.526365:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+24:11526:x1875966758568960:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1789061623.526469:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.526511:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.526526:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.526544:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.526568:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.526575:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.526868:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b3d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.526877:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.526885:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061623.526935:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.526950:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.526957:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.526964:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.526971:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061623.526976:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.526984:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527007:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:2.0:1789061623.527010:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061623.527016:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527023:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527038:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527044:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527049:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527054:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fe00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061623.527057:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527063:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527071:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a613b5800) 00010000:00010000:2.0:1789061623.527073:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061623.527076:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527082:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527109:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527116:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b3d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527122:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b3d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527127:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061623.527130:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b3d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527136:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b3d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527144:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5700) 00010000:00010000:2.0:1789061623.527146:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061623.527149:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b3d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.527155:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b3d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061623.527435:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+24:11526:x1875966758568960:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1071us (7434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061623.527446:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00100000:2.0:1789061623.556045:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779537408:0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.556143:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061623.556229:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789061623.556237:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779537024:0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.556273:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061623.556311:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875966779537536:0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.556342:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061623.556371:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875966779537280:0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.556396:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061623.556417:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061623.556423:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cd2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779537152:0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.556476:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061623.556551:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779537408 00000100:00100000:2.0:1789061623.556564:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779537408 00000100:00100000:2.0:1789061623.556638:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789061623.556650:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1875966779537408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.556707:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1875966779537408:12345-0@lo:400:kworker.0 Request processed in 60us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061623.556715:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789061623.556756:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779537024 00000100:00100000:2.0:1789061623.556760:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779537024 00000100:00100000:2.0:1789061623.556786:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789061623.556792:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3310:x1875966779537024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.556823:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3310:x1875966779537024:12345-0@lo:400:kworker.0 Request processed in 30us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061623.556829:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789061623.556858:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779537536 00000100:00100000:2.0:1789061623.556863:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779537536 00000100:00100000:2.0:1789061623.556890:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779537280 00000100:00100000:2.0:1789061623.556901:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779537280 00000100:00100000:2.0:1789061623.556919:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779537152 00000100:00100000:2.0:1789061623.556921:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779537152 00000100:00100000:2.0:1789061623.556935:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789061623.556941:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875966779537536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.556973:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875966779537536:12345-0@lo:400:kworker.0 Request processed in 33us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061623.556979:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789061623.556992:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789061623.556999:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875966779537280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.557030:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875966779537280:12345-0@lo:400:kworker.0 Request processed in 33us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061623.557036:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789061623.557048:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789061623.557054:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779537152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.557080:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779537152:12345-0@lo:400:kworker.0 Request processed in 27us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061623.557086:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1789061623.557102:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789061623.557108:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061623.557145:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779537152:0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.557157:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875966779537280:0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.557189:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779537024:0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.557200:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875966779537536:0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.557212:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cd2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779537408:0@lo:400:kworker.0 00000100:00100000:2.0:1789061623.560317:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061623.560360:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758569216 00000100:00100000:2.0:1789061623.560371:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758569216 00000100:00100000:2.0:1789061623.560438:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 188 00000100:00100000:2.0:1789061623.560450:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+24:11529:x1875966758569216:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061623.560478:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061623.560676:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b3da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a302 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.560777:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.560796:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.560810:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.560825:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.560833:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.560840:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561191:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b3ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561201:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b3ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561215:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b3ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061623.561227:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789061623.561372:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561381:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561388:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561394:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fe00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061623.561399:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561407:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561422:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:2.0:1789061623.561426:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061623.561431:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561437:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b3e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561450:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561456:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561469:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561475:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061623.561477:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561484:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561523:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a613b5700) 00010000:00010000:2.0:1789061623.561525:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061623.561529:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.561535:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b3e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.566676:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b3da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a302 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.566722:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b3ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a302 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.566826:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5800) 00010000:00010000:2.0:1789061623.566831:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061623.566836:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f400, rc 0) 00000100:00100000:2.0:1789061623.570168:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+26:11529:x1875966758569216:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 9702us (9846us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1789061623.570196:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 188 00000100:00100000:1.0:1789061623.579081:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061623.579252:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758569344 00000100:00100000:3.0:1789061623.579266:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758569344 00000100:00100000:3.0:1789061623.579348:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 189 00000100:00100000:3.0:1789061623.579360:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+26:11529:x1875966758569344:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1789061623.579444:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b3fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.579464:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b3fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.579479:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b3fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.579545:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b3fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.579553:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b3fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.579561:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b3fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.579582:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042e00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061623.579588:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b3fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.579596:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b3fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.579610:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5800) 00010000:00010000:3.0:1789061623.579614:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789061623.579620:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b3fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.579627:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b3fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061623.579710:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+26:11529:x1875966758569344:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 352us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061623.579717:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 189 00000100:00100000:0.0:1789061623.583651:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061623.583709:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758569600 00000100:00100000:0.0:1789061623.583723:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758569600 00000100:00100000:0.0:1789061623.583787:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:0.0:1789061623.583801:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+26:11529:x1875966758569600:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789061623.584141:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+27:11529:x1875966758569600:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 342us (500us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789061623.584150:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:0.0:1789061623.616051:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.616310:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758569856 00000100:00100000:1.0:1789061623.616341:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758569856 00000100:00100000:1.0:1789061623.616428:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:1.0:1789061623.616452:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+27:11064:x1875966758569856:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1789061623.617211:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061623.625838:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b404 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a309 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.627481:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.627641:0:8391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b3ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a302 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.627655:0:8391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.627708:0:8391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b3ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a302 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.627729:0:8391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b3ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a302 expref: 28 pid: 5851 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061623.627749:0:8391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945e5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8391:1875966779537664:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061623.628231:0:8391:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061623.633481:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.633634:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758569984 00000100:00100000:1.0:1789061623.633647:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758569984 00010000:00010000:1.0:1789061623.633702:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b3ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a302 expref: 29 pid: 5851 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061623.633762:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:1.0:1789061623.633774:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946382300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+29:2356:x1875966758569984:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061623.633794:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061623.633803:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b3ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a302 expref: 29 pid: 5851 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.633819:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b3ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a302 expref: 29 pid: 5851 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.633847:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5800) 00010000:00010000:1.0:1789061623.633853:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.633864:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.633874:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.633899:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061623.633983:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946382300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+29:2356:x1875966758569984:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 212us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061623.633992:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00010000:00010000:1.0:1789061623.634177:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b3ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a302 expref: 28 pid: 5851 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061623.634196:0:8391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945e5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8391:1875966779537664:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789061623.634226:0:8391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.634237:0:8391:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.634244:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061623.634266:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789061623.636907:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9b404 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a309 expref: 29 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.636944:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a309 expref: 28 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.636956:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5800) 00010000:00010000:1.0:1789061623.636959:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789061623.636964:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c000, rc 0) 00000100:00100000:1.0:1789061623.637067:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+28:11064:x1875966758569856:12345-192.168.204.54@tcp:101:bash.0 Request processed in 20618us (21028us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789061623.637078:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:2.0:1789061623.645625:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061623.648988:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758570240 00000100:00100000:3.0:1789061623.649012:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758570240 00000100:00100000:3.0:1789061623.649200:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 191 00000100:00100000:3.0:1789061623.649215:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+28:11064:x1875966758570240:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:0.0:1789061623.651035:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b419 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.651064:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b419 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.651079:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b419 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061623.651178:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1789061623.651226:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fe79dc0 reply state 000000000f4d4156 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b419 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061623.651237:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789061623.651322:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1789061623.651732:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+32:11064:x1875966758570240:12345-192.168.204.54@tcp:36:bash.0 Request processed in 2515us (6117us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1789061623.651742:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 191 00000020:00080000:0.0:1789061623.651749:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789061623.654587:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:0.0:1789061623.654602:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b419 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.654619:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b419 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.654639:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b419 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.654647:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061623.654653:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b419 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.654663:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b419 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.654685:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5800) 00010000:00010000:0.0:1789061623.654688:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061623.654695:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b419 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061623.654701:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b419 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061623.654770:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758570368 00000100:00100000:3.0:1789061623.654784:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758570368 00000100:00100000:3.0:1789061623.654840:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:3.0:1789061623.654851:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+31:11064:x1875966758570368:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789061623.654881:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061623.654903:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b420 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a310 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.654980:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b420 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a310 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.654995:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b420 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a310 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.655015:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5800) 00010000:00010000:3.0:1789061623.655018:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061623.655021:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042e00, rc 0) 00000100:00100000:3.0:1789061623.655090:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+32:11064:x1875966758570368:12345-192.168.204.54@tcp:101:bash.0 Request processed in 241us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061623.655098:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:2.0:1789061623.658750:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.659082:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758570496 00000100:00100000:1.0:1789061623.659097:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758570496 00000100:00100000:1.0:1789061623.659173:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:1.0:1789061623.659187:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:11064:x1875966758570496:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1789061623.659210:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061623.659240:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a28073d0/0x427fa11dc4a9b427 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a317 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061623.659276:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa2e9f4, atime: 0x6aa2e9f3, ctime: 0x6aa2e9f4, blocks: 0xb 00010000:00010000:1.0:1789061623.659322:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1789061623.659328:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061623.659338:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a28073d0/0x427fa11dc4a9b427 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a317 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.659371:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a28073d0/0x427fa11dc4a9b427 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a317 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.659388:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524600, rc 0) 00000100:00100000:1.0:1789061623.659481:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+8:11064:x1875966758570496:12345-192.168.204.54@tcp:101:bash.0 Request processed in 297us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061623.659735:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:0.0:1789061623.664901:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061623.664999:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758570624 00000100:00100000:3.0:1789061623.665013:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758570624 00002000:00010000:3.0:1789061623.665071:0:6707:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789061623.665076:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971945e5f800 with x1875966758570624 ext(0->18446744073709551615) 00002000:00010000:3.0:1789061623.665093:0:6707:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971945e5f800. 00000100:00100000:3.0:1789061623.665133:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1789061623.665146:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758570624:12345-192.168.204.54@tcp:10:bash.0 00002000:00010000:3.0:1789061623.665574:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789061623.665579:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789061620 -> 1789061622 00002000:00010000:3.0:1789061623.665582:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789061619 -> 1789061619 00002000:00010000:3.0:1789061623.665584:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789061620 -> 1789061622 00002000:00010000:3.0:1789061623.665586:0:6707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789061623.665678:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2356:x1875966758570624:12345-192.168.204.54@tcp:10:bash.0 Request processed in 533us (791us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789061623.665705:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00002000:00010000:3.0:1789061623.665710:0:6707:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789061623.665713:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971945e5f800 with x1875966758570624 ext(0->18446744073709551615) 00002000:00010000:3.0:1789061623.665719:0:6707:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971945e5f800. 00010000:00010000:2.0:1789061623.679536:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061623.774551:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.774773:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758570752 00000100:00100000:1.0:1789061623.774787:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758570752 00000100:00100000:1.0:1789061623.774868:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 193 00000100:00100000:1.0:1789061623.774880:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+32:11543:x1875966758570752:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1789061623.774985:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b42e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775014:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b42e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775034:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b42e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775054:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b435 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775062:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775069:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775716:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b43c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775731:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b43c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775740:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b43c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789061623.775794:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b43c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775812:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b42e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775820:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b42e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775841:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b42e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775847:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525a00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061623.775853:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b42e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775862:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b42e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775876:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:1.0:1789061623.775879:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061623.775884:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b42e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775891:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b42e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775905:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775910:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b435 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775915:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775920:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061623.775922:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775937:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b435 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775946:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a6af68200) 00010000:00010000:1.0:1789061623.775948:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061623.775952:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b435 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775958:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b435 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775973:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b43c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775979:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b43c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775984:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b43c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775989:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061623.775992:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b43c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.775997:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b43c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.776003:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5800) 00010000:00010000:1.0:1789061623.776005:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061623.776008:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b43c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.776024:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b43c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061623.776772:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+32:11543:x1875966758570752:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1888us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061623.776785:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 193 00000100:00100000:2.0:1789061623.823245:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.823430:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758571008 00000100:00100000:1.0:1789061623.823443:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758571008 00000100:00100000:1.0:1789061623.823586:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:1.0:1789061623.823607:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+32:11546:x1875966758571008:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789061623.823635:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061623.823664:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b443 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a31e expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.823759:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b44a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.823776:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b44a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.823788:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b44a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.823803:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b451 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.823809:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.823836:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824158:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b458 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824167:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824174:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061623.824183:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789061623.824307:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b44a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824315:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b44a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824322:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b44a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824328:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061623.824333:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b44a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824341:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b44a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824353:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:1.0:1789061623.824357:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061623.824369:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b44a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824375:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b44a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824387:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824393:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b451 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824398:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824403:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525a00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061623.824406:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824411:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b451 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824417:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a6af68200) 00010000:00010000:1.0:1789061623.824419:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061623.824421:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b451 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824426:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b451 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824470:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b443 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a31e expref: 35 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824551:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a31e expref: 34 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.824561:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5800) 00010000:00010000:1.0:1789061623.824563:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789061623.824567:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524e00, rc 0) 00000100:00100000:1.0:1789061623.824653:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+34:11546:x1875966758571008:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1049us (1424us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789061623.824662:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:2.0:1789061623.828583:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061623.828715:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758571136 00000100:00100000:3.0:1789061623.828727:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758571136 00000100:00100000:3.0:1789061623.828801:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:3.0:1789061623.828812:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+34:11546:x1875966758571136:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1789061623.828905:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.828924:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a309 expref: 34 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.828933:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.828977:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a309 expref: 34 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.828994:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a309 expref: 34 pid: 8391 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061623.829011:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779537792:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061623.829132:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061623.833149:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.833231:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758571392 00000100:00100000:1.0:1789061623.833244:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758571392 00000100:00100000:1.0:1789061623.833336:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:1.0:1789061623.833347:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+35:5593:x1875966758571392:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789061623.833819:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+36:5593:x1875966758571392:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 473us (683us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789061623.833828:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1789061623.836271:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779537792:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061623.836355:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061623.837587:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061623.837822:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758571520 00000100:00100000:3.0:1789061623.837834:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758571520 00010000:00010000:3.0:1789061623.837888:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a309 expref: 36 pid: 8391 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061623.837929:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:3.0:1789061623.837939:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946382d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+36:2356:x1875966758571520:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061623.837957:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061623.837964:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a309 expref: 36 pid: 8391 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.837977:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a309 expref: 36 pid: 8391 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.838003:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b40b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a309 expref: 36 pid: 8391 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.838025:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5800) 00010000:00010000:3.0:1789061623.838031:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.838042:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.838051:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.838105:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061623.838171:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946382d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+35:2356:x1875966758571520:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 233us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061623.838178:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00010000:00010000:2.0:1789061623.843160:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.843183:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.843233:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.843240:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.843249:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.843256:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061623.843261:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.843270:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.843337:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5800) 00010000:00010000:2.0:1789061623.843340:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061623.843346:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.843353:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b466 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061623.843507:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+34:11546:x1875966758571136:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 14669us (14911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061623.843878:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:2.0:1789061623.846659:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.846881:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758571776 00000100:00100000:1.0:1789061623.846895:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758571776 00000100:00100000:1.0:1789061623.846969:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:1.0:1789061623.846982:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+34:11546:x1875966758571776:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1789061623.847356:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+35:11546:x1875966758571776:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 376us (867us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1789061623.847365:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:0.0:1789061623.930153:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061623.930268:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758572032 00000100:00100000:3.0:1789061623.930293:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758572032 00000100:00100000:3.0:1789061623.930372:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:3.0:1789061623.930383:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fe9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+35:11557:x1875966758572032:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1789061623.930416:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061623.930442:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b46d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a325 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.930571:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b474 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.930602:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.930615:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.930630:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b47b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.930636:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.930642:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931051:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b482 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931062:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931069:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061623.931086:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789061623.931217:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931226:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b474 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931234:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931241:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061623.931246:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931255:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b474 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931269:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:3.0:1789061623.931272:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061623.931290:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931308:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931324:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931329:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b47b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931335:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b47b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931340:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061623.931342:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b47b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931348:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b47b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931356:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a43636b00) 00010000:00010000:3.0:1789061623.931358:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061623.931361:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b47b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931366:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b47b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931420:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b46d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a325 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931435:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a325 expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.931449:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5800) 00010000:00010000:3.0:1789061623.931451:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061623.931454:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042600, rc 0) 00000100:00100000:3.0:1789061623.931589:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fe9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+37:11557:x1875966758572032:12345-192.168.204.54@tcp:101:cat.0 Request processed in 1206us (1450us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789061623.931599:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:3.0:1789061623.941026:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061623.941308:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758572288 00000100:00100000:0.0:1789061623.941322:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758572288 00000100:00100000:0.0:1789061623.941409:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:0.0:1789061623.941420:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+37:11557:x1875966758572288:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:0.0:1789061623.941984:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11557:x1875966758572288:12345-192.168.204.54@tcp:35:cat.0 Request processed in 563us (973us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789061623.941993:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:2.0:1789061623.967886:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061623.968333:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758572544 00000100:00100000:1.0:1789061623.968366:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758572544 00000100:00100000:1.0:1789061623.968434:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 197 00000100:00100000:1.0:1789061623.968446:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11558:x1875966758572544:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:1.0:1789061623.968885:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789061623.968927:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b482 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a325 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.968958:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b458 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a31e expref: 37 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.968972:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b420 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a310 expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.968984:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a613b5800) 00010000:00010000:1.0:1789061623.968999:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061623.969030:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b490 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.969046:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b490 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.969058:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b490 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.969076:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b497 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.969082:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.969102:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.969441:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b49e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.969451:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b49e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.969459:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b49e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789061623.971027:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1789061623.971042:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398212553614ns, next at 399212551239ns, rc = 0 00010000:00010000:1.0:1789061623.971127:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9b4a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971144:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9b4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971156:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9b4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971164:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9b4a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971171:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9b4a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971176:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9b4a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971205:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789061623.971234:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b49e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971239:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b49e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971246:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b49e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971253:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061623.971258:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b49e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971266:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b49e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971292:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a6af68000) 00010000:00010000:1.0:1789061623.971295:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789061623.971301:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b49e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971307:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b49e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971329:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b490 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971335:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b490 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971340:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b490 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971350:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061623.971353:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b490 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971358:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b490 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971366:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:1.0:1789061623.971368:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061623.971371:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b490 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061623.971376:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b490 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789061623.971386:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8f3d257 reply state 000000007973279e transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061623.971396:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789061623.971569:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+37:11558:x1875966758572544:12345-192.168.204.54@tcp:36:rm.0 Request processed in 3120us (3694us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789061623.971579:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 197 00010000:00010000:2.0:1789061623.972443:0:8477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061623.972454:0:8477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9b4a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.972464:0:8477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524c00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061623.972468:0:8477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9b4a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.972477:0:8477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9b4a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.972534:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff971a6af68000) 00010000:00010000:2.0:1789061623.972537:0:8477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789061623.972542:0:8477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9b4a5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.972548:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524c00/0x427fa11dc4a9b4a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061623.972596:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061623.972598:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061623.972600:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061623.976001:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.976026:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b497 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.976036:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b497 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.976043:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525a00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061623.976049:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b497 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.976057:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b497 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.976079:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a6af68200) 00010000:00010000:3.0:1789061623.976082:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061623.976087:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b497 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061623.976093:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525a00/0x427fa11dc4a9b497 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061624.014227:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061624.014411:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758572800 00000100:00100000:3.0:1789061624.014427:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758572800 00000100:00100000:3.0:1789061624.014548:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:3.0:1789061624.014563:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+36:11564:x1875966758572800:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789061624.014722:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061624.014752:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b4ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a32c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.014920:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b4b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.014940:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b4b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.014954:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b4b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.014973:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b4ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.014980:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b4ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.014987:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b4ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789061624.018737:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789061624.019064:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b4c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.019106:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.019121:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.019166:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b4b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.019173:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b4b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.019181:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b4b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.019188:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061624.019193:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b4b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.019201:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b4b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.019216:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:3.0:1789061624.019219:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061624.019225:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b4b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.019232:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b4b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061624.019247:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051f982d2 reply state 00000000c9a21aa0 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b4ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061624.019263:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789061624.019322:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b4ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a32c expref: 39 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.019340:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a32c expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.019348:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a43636e00) 00010000:00010000:3.0:1789061624.019350:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061624.019353:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042e00, rc 0) 00000100:00100000:3.0:1789061624.019859:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+39:11564:x1875966758572800:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5296us (5645us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789061624.019870:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:2.0:1789061624.024996:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:0.0:1789061624.025175:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b4ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.025191:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b4ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.025200:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b4ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.025206:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061624.025213:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b4ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.025223:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b4ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.025247:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a43636b00) 00010000:00010000:0.0:1789061624.025285:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061624.025293:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b4ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.025299:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b4ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061624.025475:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758572928 00000100:00100000:3.0:1789061624.025530:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758572928 00000100:00100000:3.0:1789061624.025629:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:3.0:1789061624.025642:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758572928:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789061624.025667:0:8285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061624.025692:0:8285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b4cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a333 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789061624.025729:0:8285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789061624.025757:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=398s v=(0 0) 00010000:00010000:3.0:1789061624.025764:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061624.025776:0:8285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b4cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a333 expref: 8 pid: 8285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.025815:0:8285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b4cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a333 expref: 8 pid: 8285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.025831:0:8285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042800, rc 0) 00000100:00100000:3.0:1789061624.025924:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758572928:12345-192.168.204.54@tcp:101:bash.0 Request processed in 285us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061624.025932:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00080000:2.0:1789061624.026335:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061624.029627:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061624.029830:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758573056 00000100:00100000:2.0:1789061624.029844:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758573056 00000100:00100000:2.0:1789061624.030023:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1789061624.030037:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cfde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:11564:x1875966758573056:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789061624.030062:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061624.030094:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a33a expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.030141:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b4cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a333 expref: 9 pid: 8285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.030151:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061624.030156:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061624.030161:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 9 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.030207:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b4cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a333 expref: 9 pid: 8285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.030224:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b4cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a333 expref: 9 pid: 8285 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061624.030262:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946381880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6702:1875966779537920:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061624.030404:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a523980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061624.033092:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061624.033192:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758573184 00000100:00100000:3.0:1789061624.033204:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758573184 00010000:00010000:3.0:1789061624.033257:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b4cf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a333 expref: 10 pid: 8285 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061624.033323:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:3.0:1789061624.033336:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+10:2356:x1875966758573184:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061624.033356:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061624.033390:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b4cf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a333 expref: 10 pid: 8285 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.033408:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b4cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a333 expref: 10 pid: 8285 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.033441:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061624.033447:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061624.033457:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 10 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.033763:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 10 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.033825:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 10 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061624.033845:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5836:1875966779538048:192.168.204.54@tcp:105: 00000100:00100000:3.0:1789061624.033957:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde19c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789061624.034289:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3029d0e/0x427fa11dc4a9b4cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a333 expref: 10 pid: 8285 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061624.034310:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946381880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6702:1875966779537920:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061624.034353:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 9 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.034364:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e000, rc 0) 00000100:00100000:2.0:1789061624.034404:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cfde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+9:11564:x1875966758573056:12345-192.168.204.54@tcp:101:bash.0 Request processed in 4370us (4794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061624.034412:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:0.0:1789061624.039456:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061624.039618:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758573440 00000100:00100000:1.0:1789061624.039633:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758573440 00000100:00100000:1.0:1789061624.039700:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:1.0:1789061624.039710:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+38:11564:x1875966758573440:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:1.0:1789061624.040150:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+39:11564:x1875966758573440:12345-192.168.204.54@tcp:35:bash.0 Request processed in 440us (706us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789061624.040179:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:3.0:1789061624.040701:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5836:1875966779538048:192.168.204.54@tcp:105: 00010000:00010000:3.0:1789061624.040730:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061624.040765:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758573184:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 7433us (7689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061624.040774:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:2.0:1789061624.062870:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061624.062905:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779538176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061624.063004:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061624.064554:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779538176 00000100:00100000:3.0:1789061624.064573:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779538176 00000100:00100000:3.0:1789061624.064670:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789061624.064683:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779538176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061624.064717:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789061624.064822:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779538176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (1818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061624.064829:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789061624.065093:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779538176:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1789061624.176197:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1789061624.176231:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1789061624.229662:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061624.229834:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758573568 00000100:00100000:2.0:1789061624.229848:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758573568 00000100:00100000:2.0:1789061624.229945:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 199 00000100:00100000:2.0:1789061624.229960:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+39:11580:x1875966758573568:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061624.230018:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061624.230048:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b4dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a341 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.230148:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b4e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.230168:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.230182:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061624.230229:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789061624.230234:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061624.230259:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.230305:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b4dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a341 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.230339:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a341 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.230349:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:2.0:1789061624.230352:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061624.230357:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e600, rc 0) 00000100:00100000:2.0:1789061624.230438:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+40:11580:x1875966758573568:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 482us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061624.230446:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 199 00000100:00100000:0.0:1789061624.235722:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061624.235885:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758573824 00000100:00100000:1.0:1789061624.235901:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758573824 00000100:00100000:1.0:1789061624.235981:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00100000:1.0:1789061624.235995:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+40:11580:x1875966758573824:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789061624.236024:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061624.236051:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b4eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a348 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.236194:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b4f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.236214:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.236229:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061624.236244:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789061624.236688:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9b4eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a348 expref: 43 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.236713:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b4f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a348 expref: 42 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.236723:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a43636e00) 00010000:00010000:1.0:1789061624.236727:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061624.236732:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524200, rc 0) 00000100:00100000:1.0:1789061624.236826:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+42:11580:x1875966758573824:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 834us (1117us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789061624.236835:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00100000:0.0:1789061624.241950:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061624.242111:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758573952 00000100:00100000:3.0:1789061624.242125:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758573952 00000100:00100000:3.0:1789061624.242214:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1789061624.242229:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+42:2356:x1875966758573952:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061624.242281:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061624.242318:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524200/0x427fa11dc4a9b4f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a348 expref: 42 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.242342:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a43636e00) 00010000:00010000:3.0:1789061624.242348:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061624.242436:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+41:2356:x1875966758573952:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 212us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061624.242445:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1789061624.247820:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061624.248059:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758574208 00000100:00100000:2.0:1789061624.248076:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758574208 00000100:00100000:2.0:1789061624.248202:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 201 00000100:00100000:2.0:1789061624.248217:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+41:11580:x1875966758574208:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061624.248254:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061624.248297:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b500 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a34f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.248456:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b507 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.248475:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.248973:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061624.248994:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789061624.249182:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e400/0x427fa11dc4a9b500 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a34f expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.249206:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a34f expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.249216:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a43636e00) 00010000:00010000:2.0:1789061624.249219:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789061624.249223:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fe00, rc 0) 00000100:00100000:2.0:1789061624.249316:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+43:11580:x1875966758574208:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1102us (1511us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789061624.253057:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 201 00000100:00100000:0.0:1789061624.255918:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061624.256203:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758574336 00000100:00100000:3.0:1789061624.256218:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758574336 00000100:00100000:3.0:1789061624.256334:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1789061624.256347:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fe9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+6:2355:x1875966758574336:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:3.0:1789061624.256407:0:8285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.256432:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.256442:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061624.256446:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061624.256451:0:8285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.256538:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.256591:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 6 pid: 6702 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061624.256610:0:8285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8285:1875966779538304:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061624.256721:0:8285:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061624.260676:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061624.260837:0:8285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8285:1875966779538304:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061624.260879:0:8285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061624.261062:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758574464 00000100:00100000:1.0:1789061624.261071:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758574464 00002000:00100000:1.0:1789061624.261138:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff971947feb800 x1875966758574464/t0(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:45/0 lens 504/0 e 0 to 0 dl 1789061635 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789061624.261154:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971947feb800 with x1875966758574464 ext(0->8) 00010000:00010000:1.0:1789061624.261162:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 7 pid: 6702 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.261179:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 7 pid: 6702 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061624.261188:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff971947feb800 00000100:00100000:3.0:1789061624.261266:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1789061624.261289:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947feb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2355:x1875966758574464:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:0.0:1789061624.262747:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947feb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2355:x1875966758574464:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 1451us (2079us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789061624.262763:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00002000:00100000:0.0:1789061624.262776:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff971947feb800 x1875966758574464/t4294967308(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:45/0 lens 504/448 e 0 to 0 dl 1789061635 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061624.262786:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971947feb800 with x1875966758574464 ext(0->8) 00010000:00010000:0.0:1789061624.262795:0:6707:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 9 pid: 6702 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.262817:0:6707:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 9 pid: 6702 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789061624.262841:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff971947feb800 00000100:00100000:0.0:1789061624.265803:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061624.265996:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758574592 00000100:00100000:2.0:1789061624.266009:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758574592 00010000:00010000:2.0:1789061624.266061:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 9 pid: 6702 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061624.266156:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:2.0:1789061624.266169:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947feb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2353:x1875966758574592:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061624.266193:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789061624.266222:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789061624.266226:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789061622 00002000:00010000:2.0:1789061624.266229:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789061623 00002000:00010000:2.0:1789061624.266230:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789061622 00010000:00010000:2.0:1789061624.266237:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 9 pid: 6702 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.266252:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 9 pid: 6702 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.266296:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a687698c/0x427fa11dc4a9b4d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a33a expref: 9 pid: 6702 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.266332:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061624.266338:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061624.266345:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.266380:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.266425:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061624.266561:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947feb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2353:x1875966758574592:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 392us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061624.266569:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00010000:00010000:0.0:1789061624.267191:0:8285:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.267205:0:8285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.267242:0:8285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.267250:0:8285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.267258:0:8285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.267265:0:8285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061624.267289:0:8285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.267300:0:8285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.267315:0:8285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.267347:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b515 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061624.267427:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fe9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2355:x1875966758574336:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 11080us (11522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061624.267437:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:0.0:1789061624.271187:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061624.271989:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758574848 00000100:00100000:1.0:1789061624.272003:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758574848 00000100:00100000:1.0:1789061624.272089:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1789061624.272102:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a65021050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+43:11580:x1875966758574848:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:1.0:1789061624.272197:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a34f expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789061624.273343:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1789061624.273623:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1789061624.274402:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1789061624.274483:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.275935:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b4c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a32c expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.275948:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.276013:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a32c expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.276032:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b4c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a32c expref: 47 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061624.276050:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75867480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1875966779538432:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061624.276177:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cfac780 going to sleep for 11 seconds 00000100:00100000:0.0:1789061624.286955:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061624.287108:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75867480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1875966779538432:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061624.287146:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061624.287316:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758574976 00000100:00100000:3.0:1789061624.287327:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758574976 00010000:00010000:3.0:1789061624.289447:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b4c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a32c expref: 48 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061624.289553:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1789061624.289568:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fe9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+48:2356:x1875966758574976:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061624.289588:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061624.289597:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b4c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a32c expref: 48 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.289614:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a32c expref: 48 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.289667:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b4c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a32c expref: 48 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.289689:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a43636e00) 00010000:00010000:3.0:1789061624.289695:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.289706:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.289715:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.289747:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061624.289827:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fe9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+47:2356:x1875966758574976:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 263us (2888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061624.289836:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00010000:00010000:0.0:1789061624.290926:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.290956:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061624.291133:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789061624.294466:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1789061624.294741:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947fe8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779538560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789061624.294845:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061624.294900:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d4600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061624.295175:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779538560 00000100:00100000:2.0:1789061624.295187:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779538560 00000100:00100000:2.0:1789061624.295252:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789061624.295263:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947febb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875966779538560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789061624.295400:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947febb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875966779538560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 138us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061624.295408:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789061624.295637:0:5855:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1789061624.295645:0:5855:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1789061624.295681:0:5855:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff971a7cbfc380, transno 4294967307 00000100:00100000:0.0:1789061624.295701:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947fe8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779538560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789061624.296277:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1789061624.296737:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947fe8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779538688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789061624.296800:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061624.296848:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789061624.297064:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779538688 00000100:00100000:3.0:1789061624.297073:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779538688 00000100:00100000:3.0:1789061624.297130:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789061624.297140:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fe8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875966779538688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789061624.297521:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fe8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1875966779538688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 381us (719us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789061624.297530:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789061624.297878:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947fe8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1875966779538688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789061624.297965:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1789061624.298019:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.298033:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.298042:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.298049:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524e00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061624.298055:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.298064:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.298085:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a43636e00) 00010000:00010000:0.0:1789061624.298089:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789061624.298097:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.298104:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524e00/0x427fa11dc4a9b51c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789061624.298334:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789061624.299179:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1789061624.299197:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398540708463ns, next at 399540704708ns, rc = 0 00000001:00080000:0.0:1789061624.299209:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1789061624.299645:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a43636e00) 00010000:00010000:0.0:1789061624.299861:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789061624.300205:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b507 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a34f expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061624.300620:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a65021050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+50:11580:x1875966758574848:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 28518us (29443us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1789061624.300632:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000020:00080000:0.0:1789061624.300641:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789061624.307047:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061624.307193:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758575104 00000100:00100000:1.0:1789061624.307207:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758575104 00000100:00100000:1.0:1789061624.307295:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:1.0:1789061624.307308:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+50:11580:x1875966758575104:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789061624.307351:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061624.307381:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9b523 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a356 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.307460:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9b523 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a356 expref: 51 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.307478:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9b523 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a356 expref: 51 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.307866:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:1.0:1789061624.307870:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061624.307875:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525600, rc 0) 00000100:00100000:1.0:1789061624.308110:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+51:11580:x1875966758575104:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 803us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061624.308118:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:0.0:1789061624.312659:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061624.312779:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758575360 00000100:00100000:1.0:1789061624.312793:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758575360 00000100:00100000:1.0:1789061624.312869:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:1.0:1789061624.312882:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+51:11580:x1875966758575360:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1789061624.313228:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+52:11580:x1875966758575360:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 347us (582us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1789061624.313236:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:0.0:1789061624.428731:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061624.429071:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758575488 00000100:00100000:1.0:1789061624.429085:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758575488 00000100:00100000:1.0:1789061624.429169:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:1.0:1789061624.429183:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+52:11590:x1875966758575488:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1789061624.429307:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b52a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.429330:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b52a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430143:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b52a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430199:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430210:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430218:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430364:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b538 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430373:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430381:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789061624.430451:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430468:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b52a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430475:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b52a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430482:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b52a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430520:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061624.430525:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b52a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430543:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b52a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430570:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:1.0:1789061624.430574:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061624.430588:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b52a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430595:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b52a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430612:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430618:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b531 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430625:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430631:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525c00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061624.430634:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430641:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b531 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430648:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a6af68300) 00010000:00010000:1.0:1789061624.430651:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061624.430654:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b531 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430671:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b531 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430689:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430695:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b538 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430702:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430707:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061624.430711:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430717:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b538 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430725:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:1.0:1789061624.430728:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061624.430731:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b538 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.430738:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b538 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061624.430846:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+52:11590:x1875966758575488:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1662us (2127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061624.430857:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:2.0:1789061624.489608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061624.489757:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758575744 00000100:00100000:3.0:1789061624.489770:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758575744 00000100:00100000:3.0:1789061624.489853:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:3.0:1789061624.489866:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+52:11593:x1875966758575744:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061624.489913:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061624.489941:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b53f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a35d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490041:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b546 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490059:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490073:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490091:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b54d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490098:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b54d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490104:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b54d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490275:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b554 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490285:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490293:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061624.490305:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789061624.490555:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490564:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b546 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490572:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b546 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490719:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061624.490725:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b546 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490735:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b546 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490750:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:3.0:1789061624.490753:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061624.490760:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b546 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490766:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b546 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490783:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b54d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490788:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b54d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490794:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b54d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490799:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061624.490809:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b54d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490815:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b54d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490823:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a43636a00) 00010000:00010000:3.0:1789061624.490826:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061624.490829:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b54d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490834:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b54d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490887:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b53f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a35d expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490902:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a35d expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.490908:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:3.0:1789061624.490910:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061624.490913:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042800, rc 0) 00000100:00100000:3.0:1789061624.490992:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+54:11593:x1875966758575744:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1128us (1410us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789061624.491002:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:0.0:1789061624.498966:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061624.502826:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758575872 00000100:00100000:1.0:1789061624.502850:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758575872 00000100:00100000:1.0:1789061624.502991:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:1.0:1789061624.503005:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+54:11593:x1875966758575872:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1789061624.503104:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.503129:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.503143:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.503179:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.503186:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b562 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.503194:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.503201:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061624.503206:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.503214:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b562 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.503228:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:1.0:1789061624.503231:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789061624.503237:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b562 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.503261:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b562 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061624.503400:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+54:11593:x1875966758575872:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 399us (4450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061624.503409:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:0.0:1789061624.519426:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061624.519617:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758576128 00000100:00100000:1.0:1789061624.519631:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758576128 00000100:00100000:1.0:1789061624.519707:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:1.0:1789061624.519720:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+54:11593:x1875966758576128:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1789061624.520068:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+55:11593:x1875966758576128:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 350us (654us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789061624.520077:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:0.0:1789061624.647015:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061624.647130:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758576384 00000100:00100000:1.0:1789061624.647145:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758576384 00000100:00100000:1.0:1789061624.647229:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:1.0:1789061624.647243:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+55:11603:x1875966758576384:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1789061624.647291:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061624.647295:0:8391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789061624.647332:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9b4e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a341 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.647357:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:1.0:1789061624.647364:0:8391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061624.647393:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b569 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a364 expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.647626:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.647643:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.647656:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061624.647669:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789061624.647848:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b569 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a364 expref: 57 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.647866:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a364 expref: 56 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.647874:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:1.0:1789061624.647877:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061624.647880:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525c00, rc 0) 00000100:00100000:1.0:1789061624.648273:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+56:11603:x1875966758576384:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1022us (1346us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789061624.648283:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:2.0:1789061624.654367:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061624.654428:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061624.654557:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758576512 00000100:00100000:3.0:1789061624.654572:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758576512 00000100:00100000:3.0:1789061624.654670:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1789061624.654682:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946381880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+56:2353:x1875966758576512:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061624.654721:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061624.654752:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a364 expref: 56 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.654776:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:3.0:1789061624.654782:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061624.654859:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946381880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+55:2353:x1875966758576512:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 180us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061624.654867:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:1.0:1789061624.655304:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758576768 00000100:00100000:1.0:1789061624.655313:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758576768 00000100:00100000:1.0:1789061624.655354:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00100000:1.0:1789061624.655363:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+55:11603:x1875966758576768:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:1.0:1789061624.655434:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061624.655461:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b554 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a35d expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.655477:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:1.0:1789061624.655480:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061624.655794:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b57e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.655812:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b57e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.655825:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b57e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789061624.655890:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1789061624.655919:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c36ded71 reply state 00000000d7175e33 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b57e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061624.656003:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789061624.656100:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+57:11603:x1875966758576768:12345-192.168.204.54@tcp:36:bash.0 Request processed in 738us (1670us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789061624.656108:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 207 00000020:00080000:1.0:1789061624.656113:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789061624.661191:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061624.661381:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758576896 00000100:00100000:0.0:1789061624.661395:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758576896 00000100:00100000:0.0:1789061624.661469:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:0.0:1789061624.661480:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+57:11603:x1875966758576896:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789061624.661541:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061624.661577:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9b585 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a36b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.661595:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b57e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.661608:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b57e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.661617:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b57e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.661625:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061624.661631:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b57e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.661641:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b57e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.661663:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:3.0:1789061624.661667:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061624.661674:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b57e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.661695:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b58c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.661717:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b57e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.661723:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b58c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.661749:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b58c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061624.661786:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789061624.661791:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061624.661817:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b58c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.661845:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9b585 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a36b expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.661864:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b58c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a36b expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.661872:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:0.0:1789061624.661874:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061624.661877:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596dc00, rc 0) 00000100:00100000:0.0:1789061624.661942:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+57:11603:x1875966758576896:12345-192.168.204.54@tcp:101:bash.0 Request processed in 465us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061624.661949:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:0.0:1789061624.669794:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061624.669837:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758577152 00000100:00100000:1.0:1789061624.669852:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758577152 00000100:00100000:1.0:1789061624.669926:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:1.0:1789061624.669938:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+57:11603:x1875966758577152:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:1.0:1789061624.670321:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+58:11603:x1875966758577152:12345-192.168.204.54@tcp:35:bash.0 Request processed in 384us (541us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1789061624.670330:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00010000:00010000:1.0:1789061624.703557:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061624.723988:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061624.724722:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758577280 00000100:00100000:1.0:1789061624.724738:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758577280 00000100:00100000:1.0:1789061624.724822:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:1.0:1789061624.724836:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+58:11609:x1875966758577280:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789061624.724868:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061624.724895:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b593 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a372 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.724982:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b59a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.725000:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b59a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.725014:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b59a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061624.725060:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789061624.725064:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789061624.725085:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b59a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.725112:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b593 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a372 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.725133:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b59a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a372 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.725141:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:1.0:1789061624.725163:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789061624.725167:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525200, rc 0) 00000100:00100000:1.0:1789061624.725249:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+59:11609:x1875966758577280:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 417us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061624.725256:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:2.0:1789061624.729920:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061624.730036:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758577408 00000100:00100000:0.0:1789061624.730050:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758577408 00000100:00100000:0.0:1789061624.730157:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:0.0:1789061624.730170:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+59:11609:x1875966758577408:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789061624.730199:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061624.730226:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b5a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a379 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730359:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b5a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730378:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b5a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730392:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b5a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730410:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b5af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730417:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730425:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730592:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9b5b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730602:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9b5b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730610:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9b5b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061624.730657:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789061624.730663:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061624.730686:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9b5b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730712:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9b5b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730721:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b5a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730729:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b5a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730736:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b5a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730743:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061624.730747:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b5a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730756:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b5a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730770:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:0.0:1789061624.730774:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061624.730780:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b5a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730786:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d200/0x427fa11dc4a9b5a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730802:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730809:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b5af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730822:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b5af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730827:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061624.730830:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b5af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730837:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b5af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730845:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a610ee500) 00010000:00010000:0.0:1789061624.730848:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061624.730850:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b5af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730855:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b5af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730894:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9b5a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a379 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730909:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9b5b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a379 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061624.730916:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:0.0:1789061624.730917:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061624.730920:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596d800, rc 0) 00000100:00100000:0.0:1789061624.731052:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+60:11609:x1875966758577408:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 885us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061624.731071:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:0.0:1789061624.738151:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061624.738199:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061624.738993:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758577792 00000100:00100000:3.0:1789061624.739008:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758577792 00000100:00100000:3.0:1789061624.739100:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1789061624.739113:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+60:2356:x1875966758577792:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061624.739134:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061624.739166:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9b5b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a379 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061624.739191:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:3.0:1789061624.739197:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061624.739453:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+59:2356:x1875966758577792:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 341us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061624.739462:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:1.0:1789061624.739691:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758577664 00000100:00100000:1.0:1789061624.739700:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758577664 00000100:00100000:1.0:1789061624.739744:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:1.0:1789061624.739753:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+59:11609:x1875966758577664:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789061624.739774:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061624.739796:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b5bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a380 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.739917:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.739933:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b58c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a36b expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.739943:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.739984:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b58c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a36b expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.739999:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b58c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a36b expref: 60 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061624.740013:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75867b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779538816:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061624.740125:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cfacc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061624.744280:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061624.744972:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75867b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779538816:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789061624.745013:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061624.745207:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758577920 00000100:00100000:3.0:1789061624.745218:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758577920 00010000:00010000:2.0:1789061624.745484:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b58c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a36b expref: 61 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061624.745797:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:2.0:1789061624.745810:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946382a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+61:2355:x1875966758577920:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061624.745830:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061624.745838:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b58c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a36b expref: 61 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.745853:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b58c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a36b expref: 61 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.745883:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b58c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a36b expref: 61 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.745904:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:2.0:1789061624.745910:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.745922:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.745931:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.745999:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061624.746079:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946382a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+60:2355:x1875966758577920:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 272us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061624.746087:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00010000:00010000:1.0:1789061624.747483:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.747837:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061624.747864:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789061624.748082:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b5bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a380 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.748108:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a380 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.748117:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:1.0:1789061624.748120:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789061624.748124:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525c00, rc 0) 00000100:00100000:1.0:1789061624.748272:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+60:11609:x1875966758577664:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 8508us (10059us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789061624.748283:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:2.0:1789061624.751989:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061624.752091:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758578176 00000100:00100000:1.0:1789061624.752105:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758578176 00000100:00100000:1.0:1789061624.752226:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1789061624.752240:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946382300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+60:11609:x1875966758578176:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:1.0:1789061624.752295:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061624.752340:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9b523 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a356 expref: 60 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.752363:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:1.0:1789061624.752369:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061624.752443:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946382300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+59:11609:x1875966758578176:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 206us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061624.752450:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1789061624.755053:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061624.755307:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758578304 00000100:00100000:2.0:1789061624.755430:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758578304 00000100:00100000:2.0:1789061624.755720:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:2.0:1789061624.755734:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+59:11609:x1875966758578304:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:2.0:1789061624.755868:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b5d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.755888:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b5d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061624.755904:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b5d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789061624.756156:0:8391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789061624.756284:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+59:11609:x1875966758578304:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 553us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061624.756293:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:3.0:1789061624.759086:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061624.759472:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758578432 00000100:00100000:0.0:1789061624.759503:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758578432 00000100:00100000:1.0:1789061624.759669:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:1.0:1789061624.759684:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+59:11609:x1875966758578432:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789061624.759713:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061624.759942:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b5d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a387 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.760025:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b5d2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.760038:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b5d9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a387 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.760064:0:5853:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b5d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.760079:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b5d9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a387 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.760119:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:1.0:1789061624.760123:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061624.760127:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b5d9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a387 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061624.760135:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525800, rc 0) 00000100:00100000:1.0:1789061624.760220:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+60:11609:x1875966758578432:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 540us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061624.760228:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 213 00000040:00080000:1.0:1789061625.277904:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061625.277917:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061625.277990:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789061625.277998:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061625.279405:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75867b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1875966779538944:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789061625.280453:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cfacd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061625.291638:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061625.292268:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75867b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1875966779538944:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789061625.294468:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758578560 00000100:00100000:1.0:1789061625.294521:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758578560 00000100:00100000:1.0:1789061625.294638:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:1.0:1789061625.294931:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+60:11611:x1875966758578560:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789061625.294975:0:8391:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789061625.295115:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+60:11611:x1875966758578560:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 466us (3491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061625.295124:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00080000:2.0:1789061625.295844:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061625.308177:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061625.308307:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758578688 00000100:00100000:0.0:1789061625.308321:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758578688 00000100:00100000:0.0:1789061625.308396:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:0.0:1789061625.308409:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+60:11611:x1875966758578688:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789061625.308538:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b5e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308559:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308587:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308617:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308626:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308633:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308665:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308701:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308708:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061625.308757:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789061625.308762:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061625.308778:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308791:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308798:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b5e0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308805:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b5e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308810:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061625.308815:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b5e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308823:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b5e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308835:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee800) 00010000:00010000:0.0:1789061625.308838:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061625.308843:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b5e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308858:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b5e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308874:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308880:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308886:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308891:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061625.308895:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308901:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308909:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff971a610ee500) 00010000:00010000:0.0:1789061625.308912:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061625.308915:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308920:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308939:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308946:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308958:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308963:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596de00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061625.308966:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308973:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308981:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:0.0:1789061625.308984:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061625.308987:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.308994:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061625.309096:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+60:11611:x1875966758578688:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 687us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061625.309104:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:0.0:1789061625.316378:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061625.316819:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758578944 00000100:00100000:1.0:1789061625.316834:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758578944 00000100:00100000:0.0:1789061625.317334:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:0.0:1789061625.317349:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+60:11611:x1875966758578944:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789061625.317379:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061625.317408:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a38e expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.318284:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.318319:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.318333:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061625.318348:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789061625.319001:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.319014:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.319021:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.319028:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061625.319033:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.319042:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.319060:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:0.0:1789061625.319063:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789061625.319069:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.319098:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b5fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.319166:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5f5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a38e expref: 62 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.319177:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee800) 00010000:00010000:0.0:1789061625.319179:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789061625.319183:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596de00/0x427fa11dc4a9b5f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a38e expref: 62 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.319192:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596de00, rc 0) 00000100:00100000:0.0:1789061625.319312:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+61:11611:x1875966758578944:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1965us (3020us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1789061625.319322:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:3.0:1789061625.329050:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061625.329456:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758579072 00000100:00100000:0.0:1789061625.329471:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758579072 00000100:00100000:0.0:1789061625.329611:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:0.0:1789061625.329624:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+61:11611:x1875966758579072:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789061625.329674:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789061625.329807:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+61:11611:x1875966758579072:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 184us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061625.329816:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:2.0:1789061625.337739:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061625.338145:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758579328 00000100:00100000:3.0:1789061625.338159:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758579328 00000100:00100000:3.0:1789061625.338240:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:3.0:1789061625.339505:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+61:11611:x1875966758579328:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061625.339579:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061625.339584:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789061625.339731:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9b59a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a372 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.339759:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:3.0:1789061625.339766:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061625.339785:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b60a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a395 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789061625.340384:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1789061625.343149:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.343175:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.343188:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.343278:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b60a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a395 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.343311:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a395 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.343320:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff971a43636a00) 00010000:00010000:3.0:1789061625.343322:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061625.343340:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042400, rc 0) 00000100:00100000:3.0:1789061625.343417:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+62:11611:x1875966758579328:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 5168us (5694us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789061625.343425:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:2.0:1789061625.353997:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061625.354140:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758579584 00000100:00100000:0.0:1789061625.354152:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758579584 00000100:00100000:0.0:1789061625.354210:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:0.0:1789061625.354233:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+62:11611:x1875966758579584:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789061625.354349:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061625.354376:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a395 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354395:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff971a43636a00) 00010000:00010000:0.0:1789061625.354406:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061625.354427:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b61f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354441:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b61f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354450:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b61f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354463:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b626 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x378335ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354469:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x378335ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354474:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x378335ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354566:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b61f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354575:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b61f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354592:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b61f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354598:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061625.354603:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b61f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354610:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b61f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354618:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:0.0:1789061625.354621:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061625.354624:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b61f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354630:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b61f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354641:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x378335ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354646:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b626 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x378335ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354652:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x378335ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354657:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061625.354660:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x378335ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354676:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b626 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x378335ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354688:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x378335ed (ffff971a610ee500) 00010000:00010000:0.0:1789061625.354690:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061625.354693:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b626 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x378335ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.354698:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b626 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x378335ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061625.354787:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+61:11611:x1875966758579584:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 555us (799us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789061625.354795:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:0.0:1789061625.364342:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061625.364452:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758579712 00000100:00100000:2.0:1789061625.364464:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758579712 00000100:00100000:2.0:1789061625.364579:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:2.0:1789061625.364592:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+61:11611:x1875966758579712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061625.364624:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061625.364653:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b62d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a39c expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.364726:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b634 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.364741:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.364756:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.364868:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b62d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a39c expref: 63 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.364891:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a39c expref: 62 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.364900:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff971a613b5700) 00010000:00010000:2.0:1789061625.364904:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789061625.364907:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fe00, rc 0) 00000100:00100000:2.0:1789061625.364988:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+62:11611:x1875966758579712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 399us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061625.364995:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:2.0:1789061625.372004:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061625.372227:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758579968 00000100:00100000:0.0:1789061625.372240:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758579968 00000100:00100000:0.0:1789061625.372327:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:0.0:1789061625.372338:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+62:11611:x1875966758579968:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789061625.372449:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b63b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.372466:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.372478:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789061625.373047:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1789061625.373064:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 399614575968ns, next at 400614573922ns, rc = 0 00000004:00010000:0.0:1789061625.373166:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc5631f5 reply state 00000000c6619307 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061625.373175:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789061625.373391:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+64:11611:x1875966758579968:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1053us (1395us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789061625.373399:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 221 00010000:00010000:2.0:1789061625.399029:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.399047:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b63b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.399076:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b63b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.399082:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061625.399087:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b63b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.399096:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b63b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.399113:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff971a613b5700) 00010000:00010000:2.0:1789061625.399116:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789061625.399122:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b63b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.399129:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b63b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061625.409200:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061625.409555:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758580096 00000100:00100000:3.0:1789061625.409575:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758580096 00000100:00100000:3.0:1789061625.409630:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 222 00000100:00100000:3.0:1789061625.409640:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+63:11611:x1875966758580096:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061625.409663:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061625.409689:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b642 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a3a3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.409762:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3a3 expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.409778:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3a3 expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.409796:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff971a613b5700) 00010000:00010000:3.0:1789061625.409800:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061625.409803:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042e00, rc 0) 00000100:00100000:3.0:1789061625.410666:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+64:11611:x1875966758580096:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1022us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061625.410676:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 222 00000100:00100000:0.0:1789061625.421858:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061625.425153:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758580224 00000100:00100000:1.0:1789061625.425170:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758580224 00000100:00080000:2.0:1789061625.425302:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789061625.426282:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:1.0:1789061625.426379:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2356:x1875966758580224:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789061625.426836:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+10:2356:x1875966758580224:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 539us (4985us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789061625.426846:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:1.0:1789061625.435013:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061625.435457:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758580480 00000100:00100000:0.0:1789061625.435469:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758580480 00000100:00100000:0.0:1789061625.435585:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:0.0:1789061625.435595:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+64:11611:x1875966758580480:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789061625.435854:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+65:11611:x1875966758580480:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 259us (851us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789061625.435861:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1789061625.444604:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061625.444693:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758580736 00000100:00100000:3.0:1789061625.444704:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758580736 00000100:00100000:3.0:1789061625.444765:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 223 00000100:00100000:3.0:1789061625.444776:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+65:11611:x1875966758580736:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789061625.444902:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+65:11611:x1875966758580736:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 128us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061625.444910:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 223 00000100:00100000:2.0:1789061625.448934:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061625.449138:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758580864 00000100:00100000:3.0:1789061625.449149:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758580864 00000100:00100000:3.0:1789061625.449284:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:3.0:1789061625.449366:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+65:11611:x1875966758580864:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061625.449387:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061625.449409:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b649 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a3aa expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.449480:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b650 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.449530:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.449542:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061625.449935:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789061625.449957:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.449987:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b649 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3aa expref: 67 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.450006:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b650 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3aa expref: 66 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.450035:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff971a613b5700) 00010000:00010000:3.0:1789061625.450293:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789061625.450405:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042000, rc 0) 00000100:00100000:3.0:1789061625.450549:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+66:11611:x1875966758580864:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1254us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061625.450557:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:1.0:1789061625.461005:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061625.461125:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758580992 00000100:00100000:2.0:1789061625.461134:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758580992 00000100:00100000:2.0:1789061625.461276:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1789061625.461288:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+10:2355:x1875966758580992:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061625.461314:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061625.461335:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b657 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a3b1 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789061625.461384:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2e9f8, blocks: 0x1 00010000:00010000:2.0:1789061625.461407:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=399s v=(0 0) 00010000:00010000:2.0:1789061625.461411:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061625.461421:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b1 expref: 11 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.461442:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b1 expref: 11 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.461454:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e000, rc 0) 00000100:00100000:2.0:1789061625.461782:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+11:2355:x1875966758580992:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 495us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061625.461789:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1789061625.469537:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061625.469675:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758581248 00000100:00100000:3.0:1789061625.469685:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758581248 00000100:00100000:3.0:1789061625.469742:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:3.0:1789061625.469752:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7613f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+66:11611:x1875966758581248:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789061625.469866:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7613f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+66:11611:x1875966758581248:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 116us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061625.469874:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:3.0:1789061625.473637:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061625.473907:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758581376 00000100:00100000:1.0:1789061625.473918:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758581376 00000100:00100000:1.0:1789061625.473976:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:1.0:1789061625.473986:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+11:11611:x1875966758581376:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061625.474004:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061625.474022:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9b65e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a3b8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.474054:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b657 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b1 expref: 12 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.474063:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061625.474066:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061625.474071:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9b65e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b8 expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.474127:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b1 expref: 12 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.474141:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b657 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b1 expref: 12 pid: 6701 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061625.474154:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a47c29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1875966779539072:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061625.474258:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cfac300 going to sleep for 11 seconds 00000100:00100000:1.0:1789061625.478404:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061625.478553:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a47c29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1875966779539072:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789061625.478599:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9b65e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b8 expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.478620:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524000, rc 0) 00000100:00100000:0.0:1789061625.478681:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+12:11611:x1875966758581376:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 4696us (5055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061625.478690:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:2.0:1789061625.479114:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758581504 00000100:00100000:2.0:1789061625.479123:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758581504 00010000:00010000:2.0:1789061625.479157:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b657 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b1 expref: 12 pid: 6701 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061625.479194:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:2.0:1789061625.479202:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+12:2355:x1875966758581504:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061625.479215:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061625.479238:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b657 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b1 expref: 12 pid: 6701 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.479285:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b1 expref: 12 pid: 6701 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.479307:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b657 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b1 expref: 12 pid: 6701 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.479322:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061625.479326:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061625.479335:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9b65e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b8 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.479346:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9b65e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b8 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.479382:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9b65e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b8 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061625.479397:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a5cf40000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5835:1875966779539200:192.168.204.54@tcp:105: 00000100:00100000:2.0:1789061625.479788:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a52398000 going to sleep for 11 seconds 00000100:00100000:2.0:1789061625.484329:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a5cf40000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5835:1875966779539200:192.168.204.54@tcp:105: 00010000:00010000:2.0:1789061625.484357:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061625.484418:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+11:2355:x1875966758581504:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 5216us (6022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061625.484429:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:2.0:1789061625.489996:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061625.490091:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758581632 00000100:00100000:0.0:1789061625.490100:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758581632 00002000:00100000:0.0:1789061625.490162:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff971a5cf40000 x1875966758581632/t0(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:46/0 lens 504/0 e 0 to 0 dl 1789061636 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061625.490173:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a5cf40000 with x1875966758581632 ext(0->12) 00002000:00010000:0.0:1789061625.490179:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971a5cf40000 00000100:00100000:0.0:1789061625.490211:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1789061625.490221:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+11:2355:x1875966758581632:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789061625.491115:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+13:2355:x1875966758581632:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 890us (1122us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789061625.491125:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00002000:00100000:1.0:1789061625.491133:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff971a5cf40000 x1875966758581632/t4294967320(0) o4->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:46/0 lens 504/448 e 0 to 0 dl 1789061636 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789061625.491142:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a5cf40000 with x1875966758581632 ext(0->12) 00002000:00010000:1.0:1789061625.491146:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971a5cf40000 00000100:00100000:3.0:1789061625.495017:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061625.495125:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758581760 00000100:00100000:2.0:1789061625.495135:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758581760 00000100:00100000:2.0:1789061625.495193:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:2.0:1789061625.495203:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+66:11611:x1875966758581760:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789061625.537941:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1789061625.537961:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1789061625.537983:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1789061625.538000:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff971a4d6d4600 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789061625.538005:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a7ce8d300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff971a4d6d4a80 00000020:00080000:3.0:1789061625.538008:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a7ce8dd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff971945f49c00 00000004:00080000:3.0:1789061625.538067:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1789061625.538734:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff971a4fde1840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789061625.538740:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a47e1cb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff971a4fde16c0 00000020:00080000:3.0:1789061625.538757:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a47e1ca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff971a7594b400 00000020:00080000:3.0:1789061625.538905:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789061625.539166:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789061625.539186:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779539328:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789061625.539536:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061625.539664:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779539328 00000100:00100000:3.0:1789061625.539672:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779539328 00000100:00100000:3.0:1789061625.539721:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789061625.539728:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779539328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789061625.539753:0:8285:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1789061625.539789:0:8285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa2e9f6, atime: 0x6aa2e9f7, ctime: 0x6aa2e9f6, blocks: 0x1 00010000:00010000:3.0:1789061625.539797:0:8285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b665 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.539812:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:3.0:1789061625.539817:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061625.539823:0:8285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.539838:0:8285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.539847:0:8285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.539854:0:8285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.539879:0:8285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789061625.540282:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a5cf41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779539456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789061625.540607:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061625.540644:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061625.540651:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a5cf42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779539584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789061625.540672:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061625.540699:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779539456 00000100:00100000:2.0:1789061625.540705:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779539456 00000100:00100000:2.0:1789061625.540727:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779539584 00000100:00100000:2.0:1789061625.540729:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779539584 00000100:00100000:2.0:1789061625.540739:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789061625.540745:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875966779539456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789061625.540761:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1789061625.540781:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.540800:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a28073d0/0x427fa11dc4a9b427 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a317 expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.540809:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789061625.540813:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061625.540817:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.540854:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a28073d0/0x427fa11dc4a9b427 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a317 expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.540867:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a28073d0/0x427fa11dc4a9b427 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a317 expref: 12 pid: 6699 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061625.540878:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947fe9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1875966779539712:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061625.540932:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d16e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789061625.545105:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+20:11611:x1875966758581760:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 49890us (50084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061625.545120:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:3.0:1789061625.548279:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875966779539328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8543us (8736us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789061625.548291:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789061625.548334:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789061625.548345:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947feb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1875966779539584:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1789061625.548738:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff971946cdc700/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789061625.548746:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779539328:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1789061625.549231:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061625.549237:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789061625.549846:0:8285:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789061625.549852:0:8285:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789061624 00002000:00010000:3.0:1789061625.549855:0:8285:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789061625.549857:0:8285:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789061624 -> 1789061624 00002000:00010000:3.0:1789061625.549859:0:8285:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789061625.549922:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947feb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3310:x1875966779539584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1580us (9247us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789061625.549932:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1789061625.549961:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061625.549969:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.549980:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061625.549985:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.549995:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.550033:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b665 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.550056:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b322811/0x427fa11dc4a9b665 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.550079:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061625.550080:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061625.550082:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061625.550665:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000004:00080000:0.0:1789061625.550887:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff971a5cf42d80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1789061625.550895:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a5cf42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779539584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789061625.551237:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947fe9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1875966779539712:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061625.551268:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061625.551528:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758581888 00000100:00100000:1.0:1789061625.551536:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758581888 00010000:00010000:1.0:1789061625.551576:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a28073d0/0x427fa11dc4a9b427 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a317 expref: 13 pid: 6699 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061625.551612:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:1.0:1789061625.551622:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946381880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+13:2356:x1875966758581888:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061625.551647:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061625.551653:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a28073d0/0x427fa11dc4a9b427 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a317 expref: 13 pid: 6699 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.551666:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a28073d0/0x427fa11dc4a9b427 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a317 expref: 13 pid: 6699 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.551686:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a28073d0/0x427fa11dc4a9b427 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a317 expref: 13 pid: 6699 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.551701:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061625.551705:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061625.551711:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.551721:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.551742:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061625.551790:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946381880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+12:2356:x1875966758581888:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 169us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061625.551797:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00010000:00010000:3.0:1789061625.552937:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.552954:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.552966:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.552974:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.553012:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789061625.553723:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3310:x1875966779539456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12973us (13112us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789061625.553733:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1789061625.554157:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061625.554167:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.554179:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e000 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061625.554184:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.554195:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.554214:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.554222:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a687698c/0x427fa11dc4a9b66c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.554261:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061625.554263:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061625.554265:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789061625.554365:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff971a5cf41180/2, rc 0, transno 4294967322 00000100:00100000:0.0:1789061625.554373:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a5cf41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779539456:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789061625.556784:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061625.556854:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758582016 00000100:00100000:2.0:1789061625.556863:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758582016 00000100:00100000:2.0:1789061625.556923:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1789061625.556933:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+12:2356:x1875966758582016:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789061625.593192:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+12:2356:x1875966758582016:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 36248us (36404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061625.593214:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000001:00080000:3.0:1789061625.596652:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1789061625.596674:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:3.0:1789061625.596684:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:0.0:1789061625.597065:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061625.597144:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758582272 00000100:00100000:3.0:1789061625.597153:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758582272 00000100:00100000:3.0:1789061625.597261:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 227 00000100:00100000:3.0:1789061625.597272:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+20:11611:x1875966758582272:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789061625.597336:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061625.597364:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b650 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3aa expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.597383:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff971a613b5700) 00010000:00010000:3.0:1789061625.597389:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061625.597420:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b673 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.597435:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.597445:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061625.597733:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027665957 reply state 00000000c2f72e50 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061625.597753:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061625.597854:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+21:11611:x1875966758582272:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 583us (792us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789061625.597860:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 227 00000100:00100000:0.0:1789061625.601741:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061625.602267:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758582400 00000100:00100000:3.0:1789061625.602278:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758582400 00000100:00100000:3.0:1789061625.602343:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:3.0:1789061625.602352:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2355:x1875966758582400:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789061625.602820:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789061625.602824:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789061624 -> 1789061623 00002000:00010000:3.0:1789061625.602827:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789061623 00002000:00010000:3.0:1789061625.602829:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789061624 -> 1789061623 00002000:00010000:3.0:1789061625.602831:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789061625.602886:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2355:x1875966758582400:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 534us (1154us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789061625.602895:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00010000:00010000:1.0:1789061625.604907:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.604925:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b673 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.604954:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.604961:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061625.604966:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.604975:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b673 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.604993:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff971a613b5700) 00010000:00010000:1.0:1789061625.604996:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061625.605001:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b673 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.605007:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b673 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061625.605864:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061625.606007:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758582656 00000100:00100000:3.0:1789061625.606017:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758582656 00000100:00100000:3.0:1789061625.606105:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 228 00000100:00100000:3.0:1789061625.606115:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+20:11611:x1875966758582656:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789061625.606183:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.606200:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b634 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a39c expref: 20 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.606236:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.606280:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a39c expref: 20 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.606294:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b634 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a39c expref: 20 pid: 8391 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061625.606316:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779539840:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061625.606434:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fdfca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061625.610085:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061625.610170:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1875966779539840:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061625.610195:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061625.610607:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758582784 00000100:00100000:1.0:1789061625.610615:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758582784 00010000:00010000:1.0:1789061625.610650:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b634 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a39c expref: 21 pid: 8391 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061625.610688:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:1.0:1789061625.610753:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946382300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+21:2356:x1875966758582784:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061625.610769:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061625.610776:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b634 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a39c expref: 21 pid: 8391 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.611481:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a39c expref: 21 pid: 8391 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.611524:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fe00/0x427fa11dc4a9b634 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a39c expref: 21 pid: 8391 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.611542:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff971a613b5700) 00010000:00010000:1.0:1789061625.611547:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.611557:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.611564:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.611646:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061625.611710:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946382300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+20:2356:x1875966758582784:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1014us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061625.611719:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00010000:00010000:3.0:1789061625.612110:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.612179:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.612209:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.612215:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.612231:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.612257:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061625.612261:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.612268:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.612279:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff971a613b5700) 00010000:00010000:3.0:1789061625.612282:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789061625.612285:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.612291:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b67a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061625.612617:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+19:11611:x1875966758582656:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 6231us (6485us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789061625.612628:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 228 00000100:00100000:2.0:1789061625.616869:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061625.616984:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758582912 00000100:00100000:3.0:1789061625.616994:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758582912 00000100:00100000:3.0:1789061625.617088:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:3.0:1789061625.617099:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2353:x1875966758582912:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789061625.617150:0:8285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.617170:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9b65e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b8 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.617196:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061625.617201:0:8285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061625.617287:0:8285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.617329:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9b65e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b8 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.617341:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9b65e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b8 expref: 8 pid: 6699 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061625.617365:0:8285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8285:1875966779539968:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061625.617447:0:8285:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fdfca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061625.622552:0:8285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8285:1875966779539968:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061625.622592:0:8285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061625.622596:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061625.622767:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758583040 00000100:00100000:1.0:1789061625.622775:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758583040 00010000:00010000:1.0:1789061625.622814:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9b65e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b8 expref: 9 pid: 6699 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061625.622853:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1789061625.622863:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946c63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+9:2356:x1875966758583040:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061625.622985:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061625.623010:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9b65e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b8 expref: 9 pid: 6699 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.623024:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9b65e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b8 expref: 9 pid: 6699 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.623047:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab30a16b/0x427fa11dc4a9b65e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3b8 expref: 9 pid: 6699 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.623062:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061625.623067:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061625.623073:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.623083:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061625.623108:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061625.623154:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758583040:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 293us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061625.623162:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00010000:00010000:3.0:1789061625.624952:0:8285:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.624970:0:8285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.625005:0:8285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.625030:0:8285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.625039:0:8285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.625046:0:8285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061625.625051:0:8285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.625059:0:8285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.625077:0:8285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.625084:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b681 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061625.625173:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2353:x1875966758582912:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 8073us (8311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061625.625183:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:2.0:1789061625.630844:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061625.630946:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758583296 00000100:00100000:0.0:1789061625.630956:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758583296 00000100:00100000:0.0:1789061625.631016:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 229 00000100:00100000:0.0:1789061625.631028:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+19:11611:x1875966758583296:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789061625.631108:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b688 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.631138:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.631151:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.634001:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.634028:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b642 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3a3 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.634036:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.634081:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3a3 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.634112:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b642 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3a3 expref: 20 pid: 5852 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061625.634127:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1875966779540096:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061625.634271:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a52398540 going to sleep for 11 seconds 00000100:00100000:2.0:1789061625.644551:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061625.644797:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758583424 00000100:00100000:0.0:1789061625.644805:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758583424 00010000:00010000:0.0:1789061625.644845:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b642 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3a3 expref: 21 pid: 5852 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061625.644896:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:0.0:1789061625.644906:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+21:2356:x1875966758583424:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061625.644927:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061625.644935:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b642 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3a3 expref: 21 pid: 5852 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.644948:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3a3 expref: 21 pid: 5852 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.644971:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b642 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3a3 expref: 21 pid: 5852 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.644988:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff971a613b5700) 00010000:00010000:0.0:1789061625.644993:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.645003:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.645023:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061625.645044:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061625.645057:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1875966779540096:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061625.645082:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061625.645101:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+20:2356:x1875966758583424:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 195us (558us total) trans 0 rc 0/0 00010000:00010000:3.0:1789061625.645102:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061625.645115:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00010000:00010000:3.0:1789061625.648870:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789061625.649095:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1789061625.649287:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789061625.649341:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1789061625.649450:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5851:1875966779540224:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789061625.649539:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061625.649574:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a43c7b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789061625.652233:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779540224 00000100:00100000:1.0:1789061625.652263:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779540224 00000100:00100000:1.0:1789061625.652335:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789061625.652345:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1875966779540224:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789061625.652518:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1875966779540224:12345-0@lo:1000:mdt00_000.0 Request processed in 172us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061625.652526:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789061625.652556:0:5851:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1789061625.652564:0:5851:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1789061625.652585:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff971a5cf42d80, transno 4294967321 00000004:00080000:3.0:1789061625.652608:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff971a5cf41180, transno 4294967322 00000100:00100000:3.0:1789061625.652616:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5851:1875966779540224:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789061625.654744:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1789061625.654849:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5851:1875966779540352:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789061625.654918:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061625.654961:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a43c7b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789061625.654975:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779540352 00000100:00100000:0.0:1789061625.654984:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779540352 00000100:00100000:0.0:1789061625.655045:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789061625.655055:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1875966779540352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789061625.655280:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5851:x1875966779540352:12345-0@lo:1000:mdt00_000.0 Request processed in 227us (362us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789061625.655288:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789061625.655989:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5851:1875966779540352:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789061625.656031:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656422:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656446:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656452:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fc00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061625.656456:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656465:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656481:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff971a613b5700) 00010000:00010000:3.0:1789061625.656484:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061625.656507:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656514:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fc00/0x427fa11dc4a9b68f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656552:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b5d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656558:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b5d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656564:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b5d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656568:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061625.656571:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b5d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656585:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b5d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656593:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:3.0:1789061625.656596:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061625.656603:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b5d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a387 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656613:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b5d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a387 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.656622:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b5d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a387 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.657452:0:5851:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b5d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a387 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061625.657474:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a75ef7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1875966779540480:192.168.204.54@tcp:105: 00000100:00100000:2.0:1789061625.657606:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a523983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061625.663383:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061625.664520:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758583552 00000100:00100000:1.0:1789061625.664538:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758583552 00000100:00100000:1.0:1789061625.664611:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1789061625.664623:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+24:11609:x1875966758583552:12345-192.168.204.54@tcp:49:lfs.0 00000100:00100000:1.0:1789061625.664788:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+24:11609:x1875966758583552:12345-192.168.204.54@tcp:49:lfs.0 Request processed in 167us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061625.664795:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1789061625.669733:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a75ef7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1875966779540480:192.168.204.54@tcp:105: 00010000:00010000:3.0:1789061625.669768:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b5d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.669779:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9b5d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.669899:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b696 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.669915:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b696 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.669927:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b696 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.669940:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b696 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.669946:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b696 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.669954:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b696 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.669974:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061625.669978:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b696 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.669984:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b696 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.669996:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:2.0:1789061625.669999:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061625.670003:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b696 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.670008:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b696 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.670019:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.670024:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b688 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.670029:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b688 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.670669:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061625.670673:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b688 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.670681:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b688 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.670707:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:2.0:1789061625.670709:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789061625.670713:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b688 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.670718:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9b688 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061625.671026:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c2b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+23:11611:x1875966758583296:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 39997us (40188us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1789061625.671046:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 229 00000020:00080000:2.0:1789061625.671052:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789061625.674129:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061625.674138:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789061625.674378:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061625.674440:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758583808 00000100:00100000:0.0:1789061625.674448:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758583808 00000100:00100000:0.0:1789061625.674512:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 230 00000100:00100000:0.0:1789061625.674521:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+23:11609:x1875966758583808:12345-192.168.204.54@tcp:58:lfs.0 00000040:00080000:1.0:1789061625.674652:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789061625.674660:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789061625.674850:0:8391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789061625.674929:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+23:11609:x1875966758583808:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 407us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061625.674937:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 230 00000100:00100000:1.0:1789061625.682781:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061625.690661:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758584064 00000100:00100000:0.0:1789061625.690677:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758584064 00000100:00100000:2.0:1789061625.692996:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:2.0:1789061625.693010:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a65023850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+23:11611:x1875966758584064:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789061625.694101:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789061625.694216:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1789061625.701395:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b69d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.701420:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b69d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.701434:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b69d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.701445:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b69d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.701470:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b69d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.701476:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b69d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.702435:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789061625.702881:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a65023850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+25:11611:x1875966758584064:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 9867us (20106us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789061625.702892:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000020:00080000:2.0:1789061625.702899:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789061625.704522:0:8477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061625.704537:0:8477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b69d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.704549:0:8477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061625.704562:0:8477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b69d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.704594:0:8477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b69d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.704614:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff971a613b5c00) 00010000:00010000:3.0:1789061625.704617:0:8477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789061625.704623:0:8477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b69d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.704629:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f400/0x427fa11dc4a9b69d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.704654:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061625.704656:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061625.704658:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061625.726462:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061625.747349:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061625.747431:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758584192 00000100:00100000:3.0:1789061625.747441:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758584192 00000100:00100000:3.0:1789061625.747542:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 231 00000100:00100000:3.0:1789061625.747553:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a5cf42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+25:11613:x1875966758584192:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061625.747585:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061625.747607:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b6a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a3bf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.747669:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b6ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.747686:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b6ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.747697:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b6ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.747731:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b6b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.747739:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.747745:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.747996:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b6b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.748008:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a380 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.748017:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b6b9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.748050:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a380 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.748064:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a380 expref: 26 pid: 5852 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061625.748078:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779540608:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061625.748176:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fdfca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061625.751805:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1875966779540608:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061625.751835:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b6b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061625.752000:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061625.752089:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758584448 00000100:00100000:0.0:1789061625.752098:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758584448 00000100:00100000:0.0:1789061625.752162:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:0.0:1789061625.752180:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+27:5593:x1875966758584448:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789061625.752433:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+28:5593:x1875966758584448:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 254us (433us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789061625.752441:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:1.0:1789061625.755876:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061625.755968:0:7648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758584576 00000100:00100000:2.0:1789061625.755978:0:7648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758584576 00010000:00010000:2.0:1789061625.756020:0:7648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a380 expref: 28 pid: 5852 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061625.756063:0:7648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1789061625.756073:0:7648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+28:2355:x1875966758584576:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061625.756087:0:7648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061625.756094:0:7648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a380 expref: 28 pid: 5852 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.756107:0:7648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a380 expref: 28 pid: 5852 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.756129:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525c00/0x427fa11dc4a9b5c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a380 expref: 28 pid: 5852 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.756157:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:2.0:1789061625.756163:0:7648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b6b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.756172:0:7648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.756179:0:7648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b6b9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061625.756210:0:7648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061625.756279:0:7648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+27:2355:x1875966758584576:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 207us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061625.756286:0:7648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00010000:00010000:3.0:1789061625.757223:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757235:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061625.757289:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789061625.757294:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789061625.757326:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757341:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757352:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b6ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757359:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b6ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757366:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b6ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757372:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061625.757376:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b6ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757383:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b6ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757395:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:3.0:1789061625.757410:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061625.757416:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b6ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757422:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9b6ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757437:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757444:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b6b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757450:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757455:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061625.757458:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757464:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b6b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757472:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff971a43636200) 00010000:00010000:3.0:1789061625.757475:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061625.757477:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b6b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757483:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b6b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757553:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b6a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3bf expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757590:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b6b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3bf expref: 26 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061625.757597:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:3.0:1789061625.757600:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061625.757602:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042e00, rc 0) 00000100:00100000:3.0:1789061625.757654:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a5cf42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+26:11613:x1875966758584192:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 10103us (10314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061625.757660:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 231 00000100:00100000:0.0:1789061626.623703:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061626.623728:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779540736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061626.623812:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061626.623885:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779540736 00000100:00100000:0.0:1789061626.623894:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779540736 00000100:00100000:0.0:1789061626.623939:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789061626.623947:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875966779540736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061626.623986:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061626.624030:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875966779540736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061626.624037:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789061626.624082:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779540736:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789061626.688770:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789061626.688780:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789061626.689442:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789061626.689452:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061626.689979:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945c90e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1875966779540864:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789061626.690125:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a523983c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061626.708918:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061626.713054:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758584704 00000100:00100000:2.0:1789061626.713072:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758584704 00000100:00100000:2.0:1789061626.713149:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 232 00000100:00100000:2.0:1789061626.713161:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+27:11624:x1875966758584704:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789061626.713200:0:8391:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789061626.713332:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+27:11624:x1875966758584704:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 173us (4424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061626.713356:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 232 00000100:00100000:3.0:1789061626.716863:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945c90e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1875966779540864:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789061626.733081:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061626.733123:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758584960 00000100:00100000:2.0:1789061626.733132:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758584960 00000100:00100000:2.0:1789061626.733187:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:2.0:1789061626.733197:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+26:11624:x1875966758584960:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061626.733218:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061626.733256:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b6c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a3c6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061626.733358:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b6c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061626.733372:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061626.733385:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061626.733396:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789061626.733561:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ee00/0x427fa11dc4a9b6c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3c6 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061626.733580:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b6c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3c6 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061626.733588:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:2.0:1789061626.733591:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061626.733604:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e000, rc 0) 00000100:00100000:2.0:1789061626.733661:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+28:11624:x1875966758584960:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 465us (589us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789061626.733668:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 233 00010000:00010000:3.0:1789061626.754358:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061626.754688:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061626.754728:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061626.754911:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758585088 00000100:00100000:1.0:1789061626.754921:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758585088 00000100:00100000:1.0:1789061626.755034:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1789061626.755046:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+28:2353:x1875966758585088:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061626.755061:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061626.755085:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e000/0x427fa11dc4a9b6c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3c6 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061626.755102:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:1.0:1789061626.755116:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061626.755170:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+27:2353:x1875966758585088:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 126us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061626.755179:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1789061626.767249:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758585344 00000100:00100000:3.0:1789061626.767265:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758585344 00000100:00100000:0.0:1789061626.777110:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:0.0:1789061626.777123:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+27:11624:x1875966758585344:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789061626.777205:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b6d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061626.777234:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061626.777258:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061626.777431:0:8391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061626.777438:0:8391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b6d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061626.777444:0:8391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b6d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061626.777449:0:8391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061626.777453:0:8391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b6d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061626.777460:0:8391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b6d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061626.777471:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:0.0:1789061626.777474:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789061626.777479:0:8391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b6d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061626.777507:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9b6d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789061626.777979:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789061626.777985:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789061626.778523:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789061626.778532:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789061626.778690:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+28:11624:x1875966758585344:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 671us (23063us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789061626.778701:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:0.0:1789061626.781933:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061626.782196:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758585600 00000100:00100000:2.0:1789061626.782206:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758585600 00000100:00100000:2.0:1789061626.782270:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:2.0:1789061626.782281:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+28:11624:x1875966758585600:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789061626.782664:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+29:11624:x1875966758585600:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 384us (739us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789061626.782672:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000040:00080000:2.0:1789061626.841981:0:12485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789061626.841992:0:12485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789061626.842055:0:12485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789061626.842061:0:12485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061627.234361:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061627.234549:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758585856 00000100:00100000:0.0:1789061627.234559:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758585856 00000100:00100000:0.0:1789061627.234643:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00100000:0.0:1789061627.234655:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+29:11637:x1875966758585856:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789061627.234680:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061627.234703:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b6dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a3cd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061627.234806:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b6e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061627.234831:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b6e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061627.234842:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b6e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061627.234853:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789061627.234969:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c400/0x427fa11dc4a9b6dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3cd expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061627.234986:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b6e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3cd expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061627.234994:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:0.0:1789061627.234997:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789061627.235000:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596dc00, rc 0) 00000100:00100000:0.0:1789061627.235066:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+31:11637:x1875966758585856:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 413us (714us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789061627.235090:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00080000:2.0:1789061627.235370:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061627.248132:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061627.251371:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758585984 00000100:00100000:3.0:1789061627.251388:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758585984 00000100:00100000:3.0:1789061627.251781:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:3.0:1789061627.251794:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+31:11637:x1875966758585984:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1789061627.251881:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b6f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061627.251900:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061627.251931:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061627.251960:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061627.251967:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b6f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061627.251973:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061627.251979:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061627.251983:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061627.251991:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b6f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061627.252002:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:3.0:1789061627.252005:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789061627.252011:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b6f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061627.252017:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042600/0x427fa11dc4a9b6f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061627.252105:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+31:11637:x1875966758585984:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 314us (3984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061627.252114:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:1.0:1789061627.450206:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061627.451066:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758586112 00000100:00100000:3.0:1789061627.451097:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758586112 00000100:00100000:3.0:1789061627.451260:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:3.0:1789061627.451272:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758586112:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1789061627.451290:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061627.451311:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b6f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a3d4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789061627.451340:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa2e9f7, atime: 0x6aa2e9f7, ctime: 0x6aa2e9f7, blocks: 0xb 00010000:00010000:3.0:1789061627.451361:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1789061627.451366:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061627.451375:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b6f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3d4 expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061627.451395:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b6f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3d4 expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061627.451409:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042600, rc 0) 00000100:00100000:3.0:1789061627.451539:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2356:x1875966758586112:12345-192.168.204.54@tcp:101:cat.0 Request processed in 219us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061627.451546:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00080000:2.0:1789061627.458318:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061627.459332:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061627.459417:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758586240 00000100:00100000:0.0:1789061627.459427:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758586240 00002000:00100000:0.0:1789061627.459510:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff971a75f81c00 x1875966758586240/t0(0) o3->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:48/0 lens 488/0 e 0 to 0 dl 1789061638 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061627.459521:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a75f81c00 with x1875966758586240 ext(0->4095) 00002000:00010000:0.0:1789061627.459680:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971a75f81c00 00000100:00100000:0.0:1789061627.459714:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789061627.459724:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2354:x1875966758586240:12345-192.168.204.54@tcp:3:cat.0 00000100:00100000:0.0:1789061627.460024:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+8:2354:x1875966758586240:12345-192.168.204.54@tcp:3:cat.0 Request processed in 300us (698us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789061627.460033:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00002000:00100000:0.0:1789061627.460040:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff971a75f81c00 x1875966758586240/t0(0) o3->778edf7b-5a2f-4729-afd3-c88291fdad66@192.168.204.54@tcp:48/0 lens 488/4536 e 0 to 0 dl 1789061638 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061627.460048:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff971a75f81c00 with x1875966758586240 ext(0->4095) 00002000:00010000:0.0:1789061627.460051:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff971a75f81c00 00000100:00100000:1.0:1789061627.621413:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061627.621464:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061627.621558:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061627.621705:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758586496 00000100:00100000:0.0:1789061627.621715:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758586496 00000100:00100000:0.0:1789061627.621800:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:0.0:1789061627.621819:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758586496:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061627.621897:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758586496:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 89us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061627.621905:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:3.0:1789061627.623082:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758586624 00000100:00100000:3.0:1789061627.623095:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758586624 00000100:00100000:3.0:1789061627.623160:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:3.0:1789061627.623168:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758586624:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061627.623246:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758586624:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 78us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061627.623267:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00080000:1.0:1789061627.623676:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061627.623681:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061627.623832:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758586368 00000100:00100000:2.0:1789061627.623839:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758586368 00000100:00100000:2.0:1789061627.623881:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 303 00000100:00100000:2.0:1789061627.623890:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758586368:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061627.623923:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758586368:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061627.623930:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 303 00010000:00010000:2.0:1789061627.775703:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061628.670240:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779541376:0@lo:400:kworker.0 00000100:00100000:2.0:1789061628.670317:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061628.670374:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789061628.670381:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779540992:0@lo:400:kworker.0 00000100:00100000:3.0:1789061628.670392:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779541376 00000100:00100000:3.0:1789061628.670401:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779541376 00000100:00100000:2.0:1789061628.670411:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061628.670430:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779541504:0@lo:400:kworker.0 00000100:00100000:3.0:1789061628.670450:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789061628.670452:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061628.670459:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875966779541376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061628.670479:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779541248:0@lo:400:kworker.0 00000100:00100000:2.0:1789061628.670529:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061628.670538:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875966779541376:12345-0@lo:400:kworker.0 Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061628.670545:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789061628.670546:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789061628.670550:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779541120:0@lo:400:kworker.0 00000100:00100000:2.0:1789061628.670570:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061628.670597:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779541632:0@lo:400:kworker.0 00000100:00100000:2.0:1789061628.670617:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061628.670643:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779541504 00000100:00100000:2.0:1789061628.670647:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779541504 00000100:00100000:2.0:1789061628.670677:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779541248 00000100:00100000:2.0:1789061628.670679:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779541248 00000100:00100000:2.0:1789061628.670692:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779541120 00000100:00100000:2.0:1789061628.670693:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779541120 00000100:00100000:2.0:1789061628.670705:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789061628.670710:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779541504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061628.670739:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779541504:12345-0@lo:400:kworker.0 Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061628.670744:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789061628.670758:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789061628.670764:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779541248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061628.670808:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779541248:12345-0@lo:400:kworker.0 Request processed in 44us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061628.670813:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789061628.670825:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789061628.670830:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779541120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061628.670853:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875966779541120:12345-0@lo:400:kworker.0 Request processed in 23us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061628.670858:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789061628.670876:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779541632 00000100:00100000:2.0:1789061628.670879:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779541632 00000100:00100000:2.0:1789061628.670904:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789061628.670910:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a76194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875966779541632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061628.670937:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a76194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875966779541632:12345-0@lo:400:kworker.0 Request processed in 28us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061628.670942:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789061628.670982:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875966779541120:0@lo:400:kworker.0 00000100:00100000:2.0:1789061628.670992:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779541632:0@lo:400:kworker.0 00000100:00100000:2.0:1789061628.670999:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779541248:0@lo:400:kworker.0 00000100:00100000:2.0:1789061628.671047:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779541504:0@lo:400:kworker.0 00000100:00100000:2.0:1789061628.671055:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779541376:0@lo:400:kworker.0 00000100:00100000:1.0:1789061628.675575:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779540992 00000100:00100000:1.0:1789061628.675594:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779540992 00000100:00100000:1.0:1789061628.675659:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789061628.675668:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779540992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061628.675767:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779540992:12345-0@lo:400:kworker.0 Request processed in 100us (5354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061628.675774:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:1.0:1789061628.675808:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061628.675814:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061628.675817:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061628.676100:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779540992:0@lo:400:kworker.0 00010000:00010000:3.0:1789061628.800951:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061629.182459:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779541760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061629.182560:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061629.182644:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779541760 00000100:00100000:3.0:1789061629.182651:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779541760 00000100:00100000:3.0:1789061629.182699:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789061629.182707:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875966779541760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061629.182743:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061629.182787:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875966779541760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061629.182794:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789061629.182843:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779541760:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789061629.270205:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1789061629.270526:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1789061629.821652:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789061630.845470:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1789061630.845533:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:1.0:1789061630.848174:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789061630.849891:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1789061630.850020:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff971a43c7bd80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789061630.850026:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a75b65f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff971a43c7b240 00000020:00080000:3.0:1789061630.850041:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff971a75b65300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff971a6030ac00 00000020:00080000:2.0:1789061630.850077:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:2.0:1789061630.850294:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1789061630.850337:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:2.0:1789061631.741685:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779541888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061631.741788:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061631.741990:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779541888 00000100:00100000:3.0:1789061631.741999:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779541888 00000100:00100000:3.0:1789061631.742071:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789061631.742081:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779541888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789061631.742114:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061631.742170:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779541888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061631.742177:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1789061631.742271:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061631.742297:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789061631.742303:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1789061631.742321:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff971946cdc700, transno 4294967310 00000100:00100000:2.0:1789061631.742467:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779541888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789061631.870992:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789061631.933865:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789061631.933876:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789061631.933911:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789061631.933917:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061632.757811:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061632.757861:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061632.757904:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061632.757927:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061632.757950:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061632.757991:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758586752 00000100:00100000:1.0:1789061632.758002:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758586752 00000100:00100000:1.0:1789061632.758052:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 305 00000100:00100000:1.0:1789061632.758062:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758586752:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061632.758147:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758586752:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061632.758155:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 305 00000100:00100000:0.0:1789061632.758341:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758587136 00000100:00100000:0.0:1789061632.758345:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758587136 00000100:00100000:0.0:1789061632.758396:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758587008 00000100:00100000:0.0:1789061632.758399:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758587008 00000100:00100000:0.0:1789061632.758421:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:0.0:1789061632.758429:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758587136:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061632.758470:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758587136:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 43us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061632.758478:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:0.0:1789061632.758523:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:0.0:1789061632.758529:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758587008:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061632.758555:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758587008:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061632.758561:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:2.0:1789061632.758647:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758586880 00000100:00100000:2.0:1789061632.758651:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758586880 00000100:00100000:2.0:1789061632.758695:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758587264 00000100:00100000:2.0:1789061632.758698:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758587264 00000100:00100000:2.0:1789061632.758726:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:2.0:1789061632.758733:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+18:2356:x1875966758586880:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061632.758768:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+18:2356:x1875966758586880:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061632.758774:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:2.0:1789061632.758788:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:2.0:1789061632.758795:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758587264:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061632.758818:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758587264:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061632.758824:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00080000:1.0:1789061632.759595:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061632.759601:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061632.759603:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789061632.894356:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061633.790012:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779542144:0@lo:400:kworker.0 00000100:00100000:3.0:1789061633.790101:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061633.790166:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779542656:0@lo:400:kworker.0 00000100:00100000:2.0:1789061633.790178:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779542400:0@lo:400:kworker.0 00000100:00100000:3.0:1789061633.790194:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061633.790215:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779542144 00000100:00100000:2.0:1789061633.790222:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779542144 00000100:00100000:3.0:1789061633.790241:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061633.790246:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779542272:0@lo:400:kworker.0 00000100:00100000:3.0:1789061633.790269:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061633.790269:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789061633.790291:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779542144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061633.790296:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779542656 00000100:00100000:3.0:1789061633.790299:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779542656 00000100:00100000:3.0:1789061633.790341:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789061633.790346:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779542144:12345-0@lo:400:kworker.0 Request processed in 56us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061633.790347:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779542656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061633.790353:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789061633.790368:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779542272 00000100:00100000:2.0:1789061633.790372:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779542272 00000100:00100000:3.0:1789061633.790375:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779542656:12345-0@lo:400:kworker.0 Request processed in 29us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061633.790388:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789061633.790393:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789061633.790398:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947fe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779542272:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789061633.790418:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061633.790423:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061633.790435:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947fe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779542272:12345-0@lo:400:kworker.0 Request processed in 37us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061633.790440:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789061633.790469:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061633.790520:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789061633.790527:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779542016:0@lo:400:kworker.0 00000100:00100000:3.0:1789061633.790531:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779542400 00000100:00100000:3.0:1789061633.790535:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779542400 00000100:00100000:2.0:1789061633.790554:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061633.790564:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789061633.790570:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779542400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061633.790574:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779542528:0@lo:400:kworker.0 00000100:00100000:2.0:1789061633.790594:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061633.790598:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779542400:12345-0@lo:400:kworker.0 Request processed in 29us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061633.790603:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1789061633.790615:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061633.790624:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779542400:0@lo:400:kworker.0 00000100:00100000:2.0:1789061633.790654:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779542016 00000100:00100000:2.0:1789061633.790657:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779542016 00000100:00100000:2.0:1789061633.790689:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789061633.790696:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779542016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061633.790746:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779542016:12345-0@lo:400:kworker.0 Request processed in 37us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061633.790752:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789061633.790784:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779542016:0@lo:400:kworker.0 00000100:00100000:2.0:1789061633.790806:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779542528 00000100:00100000:2.0:1789061633.790810:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779542528 00000100:00100000:2.0:1789061633.790835:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789061633.790841:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779542528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061633.790878:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779542528:12345-0@lo:400:kworker.0 Request processed in 38us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061633.790884:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1789061633.790896:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061633.790912:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779542272:0@lo:400:kworker.0 00000100:00100000:2.0:1789061633.790922:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779542144:0@lo:400:kworker.0 00000100:00100000:2.0:1789061633.790930:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1789061633.790935:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1789061633.790949:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779542656:0@lo:400:kworker.0 00000100:00100000:3.0:1789061633.790951:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779542528:0@lo:400:kworker.0 00010000:00010000:1.0:1789061633.917665:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061634.018824:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061634.020523:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758587392 00000100:00100000:2.0:1789061634.020536:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758587392 00000100:00100000:2.0:1789061634.020634:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 237 00000100:00100000:2.0:1789061634.020649:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+18:11298:x1875966758587392:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789061634.020767:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+18:11298:x1875966758587392:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 123us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061634.020775:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 237 00000100:00080000:3.0:1789061634.020850:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061634.033647:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061634.042423:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758587648 00000100:00100000:0.0:1789061634.042441:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758587648 00000100:00100000:0.0:1789061634.042542:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:0.0:1789061634.042554:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+18:11298:x1875966758587648:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789061634.043569:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+19:11298:x1875966758587648:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 1010us (9925us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789061634.043581:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:2.0:1789061634.302583:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061634.302604:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779542784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061634.302670:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061634.303311:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779542784 00000100:00100000:3.0:1789061634.303322:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779542784 00000100:00100000:3.0:1789061634.303380:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789061634.303391:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779542784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061634.303513:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061634.303574:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779542784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061634.303581:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789061634.303620:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779542784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789061634.941760:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789061635.958815:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1789061635.958863:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789061635.960372:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789061635.960392:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789061635.968481:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789061636.364210:0:12689:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 13:33:53 (1789061633) 00000100:00100000:0.0:1789061636.870972:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779542912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061636.871104:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061636.871218:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779542912 00000100:00100000:0.0:1789061636.871228:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779542912 00000100:00100000:0.0:1789061636.871297:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789061636.871307:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779542912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061636.871351:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061636.871406:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779542912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061636.871414:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1789061636.871438:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061636.871564:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779542912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789061636.991866:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061637.865583:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061637.865643:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061637.865685:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061637.865883:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061637.865944:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061637.865985:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758588288 00000100:00100000:0.0:1789061637.865999:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758588288 00000100:00100000:2.0:1789061637.866008:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758587776 00000100:00100000:2.0:1789061637.866030:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758587776 00000100:00100000:0.0:1789061637.866074:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758587904 00000100:00100000:0.0:1789061637.866078:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758587904 00000100:00100000:2.0:1789061637.866080:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 307 00000100:00100000:2.0:1789061637.866091:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758587776:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061637.866098:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:0.0:1789061637.866104:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758588288:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061637.866293:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758588032 00000100:00100000:3.0:1789061637.866298:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758588032 00000100:00100000:3.0:1789061637.866333:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758588160 00000100:00100000:3.0:1789061637.866336:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758588160 00000100:00100000:3.0:1789061637.866361:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:3.0:1789061637.866369:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758588032:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061637.866453:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2356:x1875966758588288:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 348us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061637.866462:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:0.0:1789061637.866482:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:0.0:1789061637.866514:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+18:2356:x1875966758587904:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:1.0:1789061637.869037:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061637.869049:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061637.869054:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061637.869093:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:1.0:1789061637.869114:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758588160:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061637.880301:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2356:x1875966758587776:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 14184us (14705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061637.880322:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 307 00000100:00100000:3.0:1789061637.884442:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2356:x1875966758588032:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 18059us (18783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061637.884462:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:0.0:1789061637.896539:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+18:2356:x1875966758587904:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30020us (30796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061637.896579:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:1.0:1789061637.898871:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2356:x1875966758588160:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29755us (32915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061637.898890:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00010000:00010000:3.0:1789061638.024697:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061638.917822:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947feaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779543040:0@lo:400:kworker.0 00000100:00100000:3.0:1789061638.917928:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061638.918001:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779543552:0@lo:400:kworker.0 00000100:00100000:3.0:1789061638.918034:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061638.920219:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061638.920252:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779543424:0@lo:400:kworker.0 00000100:00100000:3.0:1789061638.920459:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061638.920670:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779543424 00000100:00100000:0.0:1789061638.920682:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779543424 00000100:00100000:0.0:1789061638.920762:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789061638.920773:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779543424:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789061638.920947:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061638.922087:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947fe9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779543168:0@lo:400:kworker.0 00000100:00100000:3.0:1789061638.922153:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061638.922189:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779543680:0@lo:400:kworker.0 00000100:00100000:3.0:1789061638.922216:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061638.922243:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061638.922250:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947fe9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779543296:0@lo:400:kworker.0 00000100:00100000:3.0:1789061638.922273:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061638.922316:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779543040 00000100:00100000:3.0:1789061638.922324:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779543040 00000100:00100000:3.0:1789061638.922373:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789061638.922381:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779543040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061638.924070:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779543680 00000100:00100000:1.0:1789061638.924088:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779543680 00000100:00100000:1.0:1789061638.924176:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789061638.924187:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779543680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061638.924318:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779543680:12345-0@lo:400:kworker.0 Request processed in 134us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061638.924325:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1789061638.924355:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789061638.928591:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779543424:12345-0@lo:400:kworker.0 Request processed in 7805us (8117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061638.928613:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789061638.941260:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779543040:12345-0@lo:400:kworker.0 Request processed in 18860us (23313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061638.941280:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789061638.941394:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779543552 00000100:00100000:3.0:1789061638.941407:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779543552 00000100:00100000:3.0:1789061638.941483:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779543168 00000100:00080000:0.0:1789061638.941675:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061638.941689:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779543296 00000100:00100000:0.0:1789061638.941704:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779543296 00000100:00100000:0.0:1789061638.941740:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789061638.941750:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779543552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061638.941844:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875966779543552:12345-0@lo:400:kworker.0 Request processed in 96us (23810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061638.941850:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789061638.941862:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789061638.941868:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779543296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061638.941897:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779543296:12345-0@lo:400:kworker.0 Request processed in 29us (19623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061638.941903:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1789061638.941918:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061638.942030:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779543168 00000100:00100000:3.0:1789061638.942131:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789061638.942139:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779543168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061638.942173:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779543168:12345-0@lo:400:kworker.0 Request processed in 36us (20021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061638.942179:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789061638.942250:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947fe9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779543296:0@lo:400:kworker.0 00000100:00100000:3.0:1789061638.942265:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947fe9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779543168:0@lo:400:kworker.0 00000100:00100000:3.0:1789061638.942278:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779543680:0@lo:400:kworker.0 00000100:00100000:1.0:1789061638.942515:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779543424:0@lo:400:kworker.0 00000100:00100000:0.0:1789061638.943275:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947feaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779543040:0@lo:400:kworker.0 00000100:00100000:0.0:1789061638.943292:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779543552:0@lo:400:kworker.0 00010000:00010000:1.0:1789061639.037855:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061639.426390:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061639.426425:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779543808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061639.426549:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061639.426632:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779543808 00000100:00100000:2.0:1789061639.426643:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779543808 00000100:00100000:2.0:1789061639.426706:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789061639.426716:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779543808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789061639.426763:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061639.426817:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779543808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061639.426824:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789061639.426886:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779543808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789061640.061736:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061640.107276:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061640.107528:0:8391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758588416 00000100:00100000:3.0:1789061640.107540:0:8391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758588416 00000100:00100000:3.0:1789061640.107737:0:8391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 238 00000100:00100000:3.0:1789061640.107749:0:8391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:12302:x1875966758588416:12345-192.168.204.54@tcp:101:lsof.0 00010000:00010000:3.0:1789061640.107772:0:8391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061640.107865:0:8391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b6ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a3db expref: -99 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061640.107937:0:8391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b706 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061640.108031:0:8391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061640.108424:0:8391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061640.108479:0:8391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789061640.108483:0:8391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000100:00080000:0.0:1789061640.109228:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1789061640.110478:0:8391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061640.110545:0:8391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042400/0x427fa11dc4a9b6ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3db expref: 7 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061640.111445:0:8391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3db expref: 6 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061640.111455:0:8391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:2.0:1789061640.111458:0:8391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061640.111462:0:8391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042800, rc 0) 00000100:00100000:2.0:1789061640.111721:0:8391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:12302:x1875966758588416:12345-192.168.204.54@tcp:101:lsof.0 Request processed in 3973us (4452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061640.111732:0:8391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 238 00010000:00010000:3.0:1789061641.087375:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789061641.149792:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789061641.149802:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789061641.155381:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789061641.155397:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061641.596002:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061641.596626:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758588672 00000100:00100000:0.0:1789061641.596640:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758588672 00000100:00100000:0.0:1789061641.596728:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:0.0:1789061641.596738:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+18:12303:x1875966758588672:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:0.0:1789061641.597205:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+19:12303:x1875966758588672:12345-192.168.204.54@tcp:35:umount.0 Request processed in 467us (1212us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789061641.597214:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00080000:2.0:1789061641.597452:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061641.616683:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061641.617268:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758588928 00000100:00100000:0.0:1789061641.617278:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758588928 00000100:00100000:0.0:1789061641.617341:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:0.0:1789061641.617351:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+19:12303:x1875966758588928:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:0.0:1789061641.617875:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+20:12303:x1875966758588928:12345-192.168.204.54@tcp:35:umount.0 Request processed in 524us (1203us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1789061641.617882:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1789061641.640601:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061641.641428:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758589184 00000100:00100000:0.0:1789061641.641439:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758589184 00000100:00100000:0.0:1789061641.641516:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:0.0:1789061641.641539:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a65020450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+20:12303:x1875966758589184:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:0.0:1789061641.641807:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a65020450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+21:12303:x1875966758589184:12345-192.168.204.54@tcp:35:umount.0 Request processed in 270us (1215us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789061641.641815:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1789061641.647548:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061641.647632:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758589440 00000100:00100000:0.0:1789061641.647643:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758589440 00000100:00100000:0.0:1789061641.647709:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:0.0:1789061641.647868:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+21:12303:x1875966758589440:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:0.0:1789061641.648474:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+22:12303:x1875966758589440:12345-192.168.204.54@tcp:35:umount.0 Request processed in 608us (986us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789061641.649607:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:1.0:1789061641.668533:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061641.668574:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061641.668595:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061641.668624:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061641.668653:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758590208 00000100:00100000:1.0:1789061641.668663:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758590208 00000100:00100000:0.0:1789061641.668816:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758589568 00000100:00100000:0.0:1789061641.668821:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758589568 00000100:00100000:0.0:1789061641.668862:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758589824 00000100:00100000:0.0:1789061641.668866:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758589824 00000100:00100000:2.0:1789061641.668874:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758589696 00000100:00100000:2.0:1789061641.668878:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758589696 00000100:00100000:0.0:1789061641.668885:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789061641.668893:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c97050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46360ae1-9af4-4026-b4fe-276273cba6e7+15:2355:x1875966758589568:12345-192.168.204.54@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789061641.668897:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1789061641.668902:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46360ae1-9af4-4026-b4fe-276273cba6e7+15:2355:x1875966758589824:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061641.668909:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061641.668910:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061641.668928:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41477200/0x427fa11dc4a9a9a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a038 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061641.668929:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63f000/0x427fa11dc4a9a78c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f6d expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.668953:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061641.668953:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061641.669014:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c97050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46360ae1-9af4-4026-b4fe-276273cba6e7+13:2355:x1875966758589568:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 121us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061641.669021:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789061641.669067:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1789061641.669073:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46360ae1-9af4-4026-b4fe-276273cba6e7+12:2355:x1875966758589696:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061641.669081:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061641.669090:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63ea00/0x427fa11dc4a9a6f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f35 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061641.669286:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46360ae1-9af4-4026-b4fe-276273cba6e7+11:2355:x1875966758589824:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 381us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061641.669293:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00080000:2.0:1789061641.669314:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789061641.669375:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061641.669397:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2355:x1875966758589696:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 323us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061641.669417:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1789061641.669473:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:0.0:1789061641.669481:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+7:2352:x1875966758590208:12345-192.168.204.54@tcp:9:umount.0 00000020:00000080:0.0:1789061641.669528:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9acc5 00000020:00010000:0.0:1789061641.669536:0:6699:0:(genops.c:1920:obd_stale_export_put()) Put export ffff971a75fd7800: total 0 00000100:00080000:0.0:1789061641.669540:0:6699:0:(import.c:65:import_set_state_nolock()) ffff971a75fd2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789061641.669577:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789061641.669836:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2352:x1875966758590208:12345-192.168.204.54@tcp:9:umount.0 Request processed in 355us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061641.669843:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000020:00010000:3.0:1789061641.675904:0:5839:0:(genops.c:1906:obd_stale_export_get()) Get export ffff971a75fd7800: total 0 00010000:00010000:3.0:1789061641.676398:0:5839:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff971a75fd7800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789061641.676459:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e143549/0x427fa11dc4a9b068 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a20d expref: 4 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061641.680307:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bab89d6/0x427fa11dc4a9b6f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3d4 expref: 3 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061641.680339:0:5839:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff971a75fd7800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789061641.680368:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061641.680370:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061641.680373:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061641.687047:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061641.687150:0:8285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758590336 00000100:00100000:0.0:1789061641.687160:0:8285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758590336 00000100:00100000:0.0:1789061641.687236:0:8285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:0.0:1789061641.687246:0:8285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+5:2352:x1875966758590336:12345-192.168.204.54@tcp:9:umount.0 00000020:00000080:0.0:1789061641.687277:0:8285:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9aa64 00000100:00080000:0.0:1789061641.687287:0:8285:0:(import.c:65:import_set_state_nolock()) ffff971946bcb800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789061641.687332:0:8285:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:2.0:1789061641.687621:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789061641.687685:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061641.687877:0:8285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778edf7b-5a2f-4729-afd3-c88291fdad66+2:2352:x1875966758590336:12345-192.168.204.54@tcp:9:umount.0 Request processed in 631us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061641.687885:0:8285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:2.0:1789061641.706812:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061641.707094:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758591360 00000100:00100000:3.0:1789061641.707104:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758591360 00000100:00100000:3.0:1789061641.707179:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 239 00000100:00100000:3.0:1789061641.707190:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+22:2352:x1875966758591360:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:3.0:1789061641.707222:0:5852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a700 00000020:00010000:3.0:1789061641.707238:0:5852:0:(genops.c:1920:obd_stale_export_put()) Put export ffff971a7611c000: total 0 00000100:00080000:3.0:1789061641.707242:0:5852:0:(import.c:65:import_set_state_nolock()) ffff971a76118800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789061641.707288:0:5852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1789061641.707696:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778edf7b-5a2f-4729-afd3-c88291fdad66+21:2352:x1875966758591360:12345-192.168.204.54@tcp:39:umount.0 Request processed in 506us (894us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789061641.707704:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 239 00000020:00010000:2.0:1789061641.707856:0:5838:0:(genops.c:1906:obd_stale_export_get()) Get export ffff971a7611c000: total 0 00010000:00010000:2.0:1789061641.707897:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff971a7611c000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789061641.707929:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:2.0:1789061641.707932:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789061641.707956:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031e00/0x427fa11dc4a9af49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1c0 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.707979:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:2.0:1789061641.707982:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061641.707986:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9b6b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3bf expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.708011:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:2.0:1789061641.708013:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789061641.708017:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ca00/0x427fa11dc4a9aa3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a062 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.708029:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:2.0:1789061641.708031:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061641.708035:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ce00/0x427fa11dc4a9b0bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a222 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.708047:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:2.0:1789061641.708049:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789061641.708052:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596dc00/0x427fa11dc4a9b6e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3cd expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.708063:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee800) 00010000:00010000:2.0:1789061641.708073:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061641.708077:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c200/0x427fa11dc4a9a9e6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a04d expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.708098:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:2.0:1789061641.708101:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789061641.708105:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525e00/0x427fa11dc4a9b3b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a2fb expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.708116:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff971a6af68d00) 00010000:00010000:2.0:1789061641.708118:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789061641.708122:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525800/0x427fa11dc4a9b5d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a387 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.708146:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff971a43636c00) 00010000:00010000:2.0:1789061641.708149:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789061641.708153:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030600/0x427fa11dc4a9b0d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a229 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.708170:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:2.0:1789061641.708173:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061641.708176:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c600/0x427fa11dc4a9b029 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a1f8 expref: 11 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.708186:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff971a610eef00) 00010000:00010000:2.0:1789061641.708188:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789061641.708192:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40030c00/0x427fa11dc4a9b053 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a206 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.708222:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff971a610eee00) 00010000:00010000:2.0:1789061641.708224:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789061641.708228:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a40031800/0x427fa11dc4a9ad27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a134 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.708242:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff971a613b5200) 00010000:00010000:2.0:1789061641.708244:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061641.708247:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f800/0x427fa11dc4a9a9ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a046 expref: 8 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061641.708260:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff971a7611c000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789061641.708273:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061641.708275:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061641.708277:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061641.984177:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061641.984246:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779543936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061641.984358:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061641.984516:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779543936 00000100:00100000:2.0:1789061641.984526:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779543936 00000100:00100000:2.0:1789061641.984600:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789061641.984610:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7c604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779543936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061641.984661:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061641.984724:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7c604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779543936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061641.984732:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789061641.985311:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779543936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789061641.986813:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789061642.112433:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061642.980077:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061642.981247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758591488 00000100:00100000:2.0:1789061642.981261:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758591488 00000100:00100000:2.0:1789061642.981335:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 309 00000100:00100000:2.0:1789061642.981347:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2356:x1875966758591488:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061642.981462:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2356:x1875966758591488:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 118us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061642.981471:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 309 00000100:00100000:1.0:1789061642.985735:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061642.987055:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758591616 00000100:00100000:2.0:1789061642.987070:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758591616 00000100:00100000:2.0:1789061642.987280:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:2.0:1789061642.987293:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:2356:x1875966758591616:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061642.987387:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:2356:x1875966758591616:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 97us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061642.987394:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00080000:0.0:1789061643.001285:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789061643.135352:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061644.036425:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779544064:0@lo:400:kworker.0 00000100:00100000:1.0:1789061644.036551:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061644.037636:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779544448:0@lo:400:kworker.0 00000100:00100000:0.0:1789061644.037686:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061644.037746:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779544448 00000100:00100000:0.0:1789061644.037768:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779544448 00000100:00100000:0.0:1789061644.037833:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789061644.037842:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779544448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061644.037907:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779544448:12345-0@lo:400:kworker.0 Request processed in 50us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061644.037914:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1789061644.037938:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061644.037969:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779544448:0@lo:400:kworker.0 00000100:00100000:0.0:1789061644.038015:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779544192:0@lo:400:kworker.0 00000100:00100000:0.0:1789061644.039095:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061644.039129:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061644.039138:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779544320:0@lo:400:kworker.0 00000100:00100000:0.0:1789061644.039163:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061644.039197:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779544192 00000100:00100000:0.0:1789061644.039203:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779544192 00000100:00100000:0.0:1789061644.039253:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779544320 00000100:00100000:0.0:1789061644.039257:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779544320 00000100:00100000:0.0:1789061644.039287:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789061644.039295:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779544192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061644.039338:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779544192:12345-0@lo:400:kworker.0 Request processed in 43us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061644.039345:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789061644.039362:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789061644.039369:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779544320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061644.039396:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779544320:12345-0@lo:400:kworker.0 Request processed in 28us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061644.039417:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1789061644.039437:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061644.039463:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779544320:0@lo:400:kworker.0 00000100:00100000:0.0:1789061644.039473:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779544192:0@lo:400:kworker.0 00000100:00100000:3.0:1789061644.045244:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779544064 00000100:00100000:3.0:1789061644.045263:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779544064 00000100:00100000:3.0:1789061644.045345:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789061644.045356:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779544064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061644.045970:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061644.045984:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779544576:0@lo:400:kworker.0 00000100:00100000:2.0:1789061644.046043:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061644.046087:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779544576 00000100:00100000:2.0:1789061644.046092:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779544576 00000100:00100000:2.0:1789061644.046135:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789061644.046143:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779544576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061644.046184:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875966779544576:12345-0@lo:400:kworker.0 Request processed in 42us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061644.046190:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:2.0:1789061644.046225:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061644.046253:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875966779544576:0@lo:400:kworker.0 00000100:00100000:2.0:1789061644.046293:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779544704:0@lo:400:kworker.0 00000100:00100000:2.0:1789061644.046319:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061644.046373:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779544704 00000100:00100000:2.0:1789061644.046389:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779544704 00000100:00100000:2.0:1789061644.046421:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789061644.046427:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779544704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061644.046462:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779544704:12345-0@lo:400:kworker.0 Request processed in 36us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061644.046469:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1789061644.046483:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061644.046526:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779544704:0@lo:400:kworker.0 00000100:00100000:3.0:1789061644.047629:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24dfd7ac-7455-4043-9449-a564380782df+19:3313:x1875966779544064:12345-0@lo:400:kworker.0 Request processed in 2270us (11072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061644.047643:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789061644.047946:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779544064:0@lo:400:kworker.0 00010000:00010000:1.0:1789061644.157685:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061644.339977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061644.340209:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758591744 00000100:00100000:2.0:1789061644.340233:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758591744 00000100:00100000:2.0:1789061644.340328:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:2.0:1789061644.340339:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2356:x1875966758591744:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061644.340355:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061644.340374:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7c524a00/0x427fa11dc4a9a7d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f82 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061644.340392:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061644.340456:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46360ae1-9af4-4026-b4fe-276273cba6e7+9:2356:x1875966758591744:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 119us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061644.340462:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1789061644.341573:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061644.341628:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061644.341691:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758592000 00000100:00100000:2.0:1789061644.341699:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758592000 00000100:00100000:2.0:1789061644.341755:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758591872 00000100:00100000:2.0:1789061644.341759:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758591872 00000100:00100000:2.0:1789061644.341789:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1789061644.341799:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2356:x1875966758592000:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061644.341816:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789061644.342155:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:3.0:1789061644.342166:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46360ae1-9af4-4026-b4fe-276273cba6e7+10:2356:x1875966758591872:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061644.342175:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061644.342193:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7c525000/0x427fa11dc4a9a7d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89fac expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061644.342343:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061644.342404:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46360ae1-9af4-4026-b4fe-276273cba6e7+9:2356:x1875966758591872:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 241us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061644.342413:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00010000:00010000:2.0:1789061644.342575:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7c525400/0x427fa11dc4a9a999 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a031 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061644.342586:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061644.342609:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46360ae1-9af4-4026-b4fe-276273cba6e7+7:2356:x1875966758592000:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 812us (2590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061644.342616:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:1.0:1789061644.342720:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061644.343112:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758592256 00000100:00100000:0.0:1789061644.343118:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758592256 00000100:00100000:0.0:1789061644.343171:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 240 00000100:00100000:0.0:1789061644.343179:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+6:2352:x1875966758592256:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:0.0:1789061644.343296:0:5853:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a7e7 00000020:00010000:0.0:1789061644.343306:0:5853:0:(genops.c:1920:obd_stale_export_put()) Put export ffff971a7cada000: total 0 00000100:00080000:0.0:1789061644.343311:0:5853:0:(import.c:65:import_set_state_nolock()) ffff971a7cade800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789061644.343340:0:5853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1789061644.343570:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49f27ef9-7067-4c53-ba32-5835a74a1c61+5:2352:x1875966758592256:12345-192.168.204.54@tcp:39:umount.0 Request processed in 391us (850us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789061644.343579:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 240 00000100:00080000:2.0:1789061644.343685:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1789061644.343725:0:5838:0:(genops.c:1906:obd_stale_export_get()) Get export ffff971a7cada000: total 0 00010000:00010000:1.0:1789061644.343766:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff971a7cada000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789061644.343792:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a610ee600) 00010000:00010000:1.0:1789061644.343796:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789061644.343804:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9b706 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3db expref: 4 pid: 8391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061644.343828:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff971a7cada000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789061644.344747:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061644.344751:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061644.344753:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061644.361963:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061644.362546:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758592512 00000100:00100000:3.0:1789061644.362557:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758592512 00000100:00100000:3.0:1789061644.362618:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 311 00000100:00100000:3.0:1789061644.362629:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a46c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+7:2352:x1875966758592512:12345-192.168.204.54@tcp:251:umount.0 00000020:00000080:3.0:1789061644.362698:0:5843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a6dd 00000020:00010000:3.0:1789061644.362706:0:5843:0:(genops.c:1920:obd_stale_export_put()) Put export ffff971a4d7d1800: total 0 00000100:00080000:3.0:1789061644.362712:0:5843:0:(import.c:65:import_set_state_nolock()) ffff971a4d7d6800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789061644.362793:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a46c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46360ae1-9af4-4026-b4fe-276273cba6e7+3:2352:x1875966758592512:12345-192.168.204.54@tcp:251:umount.0 Request processed in 166us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061644.362802:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 311 00000020:00010000:2.0:1789061644.362989:0:8477:0:(genops.c:1906:obd_stale_export_get()) Get export ffff971a4d7d1800: total 0 00010000:00010000:2.0:1789061644.362994:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061644.363048:0:8477:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff971a4d7d1800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789061644.363081:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41477400/0x427fa11dc4a9a793 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca89f74 expref: 2 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061644.363097:0:8477:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff971a4d7d1800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789061644.363105:0:8477:0:(genops.c:885:class_export_put()) final put ffff971a4d7d1800/46360ae1-9af4-4026-b4fe-276273cba6e7 00010000:00010000:2.0:1789061644.363125:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061644.363127:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061644.363129:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789061644.364475:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a4d7d1800/46360ae1-9af4-4026-b4fe-276273cba6e7 for MGS 00000020:00000080:3.0:1789061644.364561:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a4d7d6800 for MGS 00000100:00100000:3.0:1789061644.542166:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061644.542193:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779544832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061644.542278:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061644.542799:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779544832 00000100:00100000:2.0:1789061644.542809:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779544832 00000100:00100000:2.0:1789061644.542867:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789061644.542877:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779544832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789061644.542924:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061644.542996:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779544832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061644.543003:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789061644.543169:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779544832:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1789061644.652964:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 778edf7b-5a2f-4729-afd3-c88291fdad66 00000020:00000080:0.0:1789061644.652976:0:6725:0:(genops.c:885:class_export_put()) final put ffff971946bcd800/778edf7b-5a2f-4729-afd3-c88291fdad66 00000020:00000080:0.0:1789061644.653003:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971946bcd800/778edf7b-5a2f-4729-afd3-c88291fdad66 for lustre-OST0000 00000020:00000080:0.0:1789061644.653051:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971946bcb800 for lustre-OST0000 00010000:00010000:1.0:1789061645.197943:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789061646.133363:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 778edf7b-5a2f-4729-afd3-c88291fdad66 00000020:00000080:0.0:1789061646.133373:0:7660:0:(genops.c:885:class_export_put()) final put ffff971a75fd7800/778edf7b-5a2f-4729-afd3-c88291fdad66 00000020:00000080:0.0:1789061646.133406:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff971a75fd7800/778edf7b-5a2f-4729-afd3-c88291fdad66 for lustre-OST0001 00000020:00000080:0.0:1789061646.133756:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a75fd2800 for lustre-OST0001 00000001:00100000:2.0:1789061646.141711:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 49f27ef9-7067-4c53-ba32-5835a74a1c61 00000001:00080000:2.0:1789061646.141730:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789061646.141745:0:5873:0:(genops.c:885:class_export_put()) final put ffff971a7cada000/49f27ef9-7067-4c53-ba32-5835a74a1c61 00000001:00080000:2.0:1789061646.141765:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1789061646.141777:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 778edf7b-5a2f-4729-afd3-c88291fdad66 00000001:00080000:2.0:1789061646.141781:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1789061646.141783:0:5873:0:(genops.c:885:class_export_put()) final put ffff971a7611c000/778edf7b-5a2f-4729-afd3-c88291fdad66 00000020:00000080:2.0:1789061646.141800:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a7cada000/49f27ef9-7067-4c53-ba32-5835a74a1c61 for lustre-MDT0000 00000020:00000080:2.0:1789061646.141870:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a7611c000/778edf7b-5a2f-4729-afd3-c88291fdad66 for lustre-MDT0000 00000020:00000080:2.0:1789061646.141900:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a7cade800 for lustre-MDT0000 00000020:00000080:2.0:1789061646.143019:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a76118800 for lustre-MDT0000 00010000:00010000:1.0:1789061646.205663:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789061646.937579:0:12890:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789061646.981734:0:12890:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789061646.981788:0:12890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061646.981804:0:12890:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061646.981813:0:12890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061646.981820:0:12890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061646.981852:0:12890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789061646.981858:0:12890:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789061646.981937:0:12890:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789061646.981942:0:12890:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789061646.981948:0:12890:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789061646.981987:0:12890:0:(import.c:65:import_set_state_nolock()) ffff971a7c2fa000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789061646.982141:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875966779544960:0@lo:39:umount.0 00000100:00100000:1.0:1789061646.982215:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061646.982418:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779544960 00000100:00100000:3.0:1789061646.982428:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779544960 00000100:00100000:3.0:1789061646.982482:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00010000:00010000:2.0:1789061646.982855:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061646.982864:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061646.982874:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc84200 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1789061646.982878:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061646.982888:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061646.983034:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061646.983041:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789061646.983044:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789061646.983047:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789061646.983197:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061646.983204:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061646.983242:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061646.983250:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4cc84200/0x427fa11dc4a9a762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061646.983261:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061646.983264:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061646.983265:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061646.983391:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875966779544960:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789061646.983418:0:5851:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a4ec 00000100:00080000:3.0:1789061646.983428:0:5851:0:(import.c:65:import_set_state_nolock()) ffff971a7c2fe800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789061646.983530:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1875966779544960:12345-0@lo:39:umount.0 Request processed in 143us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061646.983585:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779545088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789061646.983621:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061646.983663:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779545088 00000100:00100000:0.0:1789061646.983668:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779545088 00000100:00100000:0.0:1789061646.983704:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789061646.983710:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+19:3312:x1875966779545088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789061646.983721:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061646.983736:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4cc84e00/0x427fa11dc4a9a769 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a762 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.983748:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061646.983772:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+18:3312:x1875966779545088:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061646.983778:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789061646.983815:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779545088:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789061646.983993:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789061646.985835:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971a7c2fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789061646.985982:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875966779544960:0@lo:39:umount.0 00000100:00100000:3.0:1789061646.986098:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1789061646.986116:0:5851:0:(genops.c:885:class_export_put()) final put ffff971a7c2ff800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789061646.986525:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a7c2ff800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789061646.986610:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a7c2fe800 for lustre-MDT0000 00000100:00080000:0.0:1789061646.988259:0:12890:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789061646.988268:0:12890:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789061646.988275:0:12890:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789061646.991195:0:12890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.991214:0:12890:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.991222:0:12890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.991244:0:12890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.991321:0:12890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789061646.991329:0:12890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.991345:0:12890:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.991352:0:12890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.991359:0:12890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061646.996464:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789061646.996479:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061646.996516:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc84c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061646.996540:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061646.996551:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061646.996558:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061646.996564:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789061646.996567:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789061646.996624:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061646.996631:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061646.996667:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061646.996674:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4cc84c00/0x427fa11dc4a9a770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061646.996692:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061646.996696:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061646.996701:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a40030a00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061646.996704:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061646.996711:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061646.996727:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061646.996732:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789061646.996735:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1789061646.996747:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061646.996758:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061646.996778:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061646.996786:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061646.996787:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061646.996790:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061646.996814:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779545344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061646.996913:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061646.996984:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779545344 00000100:00100000:1.0:1789061646.996992:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779545344 00000100:00100000:1.0:1789061646.997040:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789061646.997048:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a47c94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+18:3310:x1875966779545344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061646.997062:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061646.997089:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63f200/0x427fa11dc4a9a69e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a697 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061646.997106:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061646.997143:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a47c94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+17:3310:x1875966779545344:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061646.997160:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789061646.997230:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779545344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061646.997482:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779545216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061646.997541:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061646.998805:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779545216 00000100:00100000:1.0:1789061646.998817:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779545216 00000100:00100000:1.0:1789061646.998893:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789061646.998910:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+17:3313:x1875966779545216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061646.998928:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061646.998947:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9a777 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a770 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061646.998963:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061646.999033:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+16:3313:x1875966779545216:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061646.999040:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789061646.999116:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24dfd7ac-7455-4043-9449-a564380782df:3313:1875966779545216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789061646.999317:0:12890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789061646.999663:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061646.999694:0:12890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a40030a00/0x427fa11dc4a9a697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a69e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061646.999719:0:12890:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789061646.999732:0:12890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.999741:0:12890:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.999747:0:12890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.999769:0:12890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.999819:0:12890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789061646.999828:0:12890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84600/0x427fa11dc4a9a44b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.999847:0:12890:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84600/0x427fa11dc4a9a44b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.999853:0:12890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84600/0x427fa11dc4a9a44b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061646.999859:0:12890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff971a4cc84600/0x427fa11dc4a9a44b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061647.006031:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789061647.006050:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061647.006064:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1789061647.006079:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061647.006090:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061647.006099:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061647.006105:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789061647.006108:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789061647.006111:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789061647.006242:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061647.006251:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061647.006288:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061647.006295:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a41476400/0x427fa11dc4a9a98b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a992 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061647.006317:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061647.006347:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779545472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061647.006422:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061647.006525:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779545472 00000100:00100000:1.0:1789061647.006534:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779545472 00000100:00100000:1.0:1789061647.006587:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789061647.006597:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+16:3310:x1875966779545472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061647.006610:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061647.006625:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41476a00/0x427fa11dc4a9a992 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a98b expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061647.006637:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061647.006671:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24dfd7ac-7455-4043-9449-a564380782df+15:3310:x1875966779545472:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061647.006678:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789061647.006720:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779545472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061647.006737:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061647.006742:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4cc84600/0x427fa11dc4a9a44b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061647.006749:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc84600 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061647.006752:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84600/0x427fa11dc4a9a44b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061647.006759:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4cc84600/0x427fa11dc4a9a44b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061647.006765:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84600/0x427fa11dc4a9a44b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061647.006771:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789061647.006773:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1789061647.006795:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a4cc84600/0x427fa11dc4a9a44b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061647.006800:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061647.006819:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4cc84600/0x427fa11dc4a9a44b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061647.006833:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779545600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061647.006872:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061647.006912:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779545600 00000100:00100000:1.0:1789061647.006916:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779545600 00000100:00100000:1.0:1789061647.006940:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789061647.006946:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+15:3312:x1875966779545600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061647.006955:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061647.006964:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a82042c00/0x427fa11dc4a9a452 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a44b expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061647.006976:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061647.007001:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24dfd7ac-7455-4043-9449-a564380782df+14:3312:x1875966779545600:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061647.007007:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789061647.007030:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779545600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061647.007044:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061647.007046:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061647.007048:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061647.009139:0:12890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789061647.009156:0:12890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4cc84600/0x427fa11dc4a9a44b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a452 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061647.009181:0:12890:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1789061647.009191:0:12890:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1789061647.009194:0:12890:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789061647.009235:0:12890:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789061647.009239:0:12890:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789061647.009244:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061647.009251:0:12890:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1789061647.009258:0:12890:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff971a4d7d1000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789061647.009263:0:12890:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff971944d99000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789061647.009283:0:12890:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff971a761a19c0) has exports, disconnecting them 00000020:00080000:0.0:1789061647.009287:0:12890:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff971a4d7d1000), last request at 1789061644 00000020:00000080:0.0:1789061647.009295:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a65f 00000100:00080000:0.0:1789061647.009314:0:12890:0:(import.c:65:import_set_state_nolock()) ffff971a4d7d0000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789061647.009378:0:12890:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff971a4d7d1000): rc 0 00000020:00000080:0.0:1789061647.009381:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a4d7d1000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789061647.009391:0:12890:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff971944d99000), last request at 1789061644 00000020:00000080:0.0:1789061647.009394:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a594 00000100:00080000:0.0:1789061647.009400:0:12890:0:(import.c:65:import_set_state_nolock()) ffff971944d9c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789061647.009409:0:12890:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff971944d99000): rc 0 00000020:00000080:0.0:1789061647.009411:0:12890:0:(genops.c:885:class_export_put()) final put ffff971944d99000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1789061647.009421:0:12890:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb7c9c228fae0 00000100:00080000:0.0:1789061647.009441:0:12890:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789061647.009445:0:12890:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1789061647.009459:0:12890:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1789061647.009654:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061647.009662:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061647.009913:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1875966779545728:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789061647.010028:0:12890:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789061647.010042:0:12890:0:(import.c:65:import_set_state_nolock()) ffff971944fff000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789061647.010058:0:12890:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789061647.010061:0:12890:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1789061647.010070:0:12890:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789061647.010139:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779545856:0@lo:9:umount.0 00000100:00100000:0.0:1789061647.010209:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061647.010259:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779545856 00000100:00100000:0.0:1789061647.010268:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779545856 00000100:00100000:0.0:1789061647.010321:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789061647.010341:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875966779545856:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789061647.010365:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a5e1 00000100:00080000:0.0:1789061647.010372:0:6699:0:(import.c:65:import_set_state_nolock()) ffff971944d9a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789061647.010412:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789061647.010760:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3309:x1875966779545856:12345-0@lo:9:umount.0 Request processed in 430us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061647.010767:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1789061647.010808:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971944fff000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789061647.010817:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789061647.010819:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789061647.010822:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779545856:0@lo:9:umount.0 00010000:00010000:0.0:1789061647.010857:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789061647.010866:0:12890:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789061647.010877:0:12890:0:(import.c:65:import_set_state_nolock()) ffff971a7cb44800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789061647.010998:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789061647.011011:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1789061647.011029:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a4d7d1000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789061647.011076:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971944d99000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789061647.011097:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a4d7d0000 for lustre-MDT0000 00000020:00000080:2.0:1789061647.011102:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971944d9c800 for lustre-MDT0000 00000020:00080000:2.0:1789061647.011655:0:12890:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff971a761a19c0) has no exports 00000100:00100000:0.0:1789061647.012146:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779545984:0@lo:9:umount.0 00000100:00100000:0.0:1789061647.012200:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061647.013060:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779545984 00000100:00100000:2.0:1789061647.013082:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779545984 00000100:00100000:2.0:1789061647.013141:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789061647.013152:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875966779545984:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789061647.013180:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a6c8 00000100:00080000:2.0:1789061647.013188:0:6702:0:(import.c:65:import_set_state_nolock()) ffff971a68186000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789061647.013220:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789061647.013571:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3309:x1875966779545984:12345-0@lo:9:umount.0 Request processed in 422us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061647.013579:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789061647.013601:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789061647.013613:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789061647.013642:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971a7cb44800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789061647.013654:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789061647.013657:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789061647.013660:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779545984:0@lo:9:umount.0 00000020:00080000:1.0:1789061647.022071:0:12890:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff971a761a19c0) has no exports 00000020:00000080:1.0:1789061647.129466:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a4a6 00000020:00000080:1.0:1789061647.129616:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a7c2dc800/lustre-QMT0000_UUID 00000020:01000000:1.0:1789061647.129687:0:12890:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789061647.129845:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061647.129856:0:12890:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789061647.129861:0:12890:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff971a761a0000) has no exports 00000020:00000080:2.0:1789061647.129923:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a7c2dc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789061647.130351:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a49f 00000020:00000080:0.0:1789061647.130358:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a76147000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789061647.130426:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061647.130434:0:12890:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789061647.130437:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a761ab000/lustre-QMT0000_UUID 00000020:00000080:0.0:1789061647.130439:0:12890:0:(genops.c:844:class_export_destroy()) destroying export ffff971a761ab000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789061647.130448:0:12890:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789061647.131139:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a76147000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789061647.131217:0:12890:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff971a7d22e120 - data ffff971a4dc2d1b0/ffff971a75a77c00 00000020:01000000:0.0:1789061647.134717:0:12890:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff971a47e49de0 - data ffff971a68777798/ffff971a7584c800 00000001:00000004:1.0:1789061647.160640:0:12890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:1.0:1789061647.234179:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789061647.298047:0:12890:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789061647.298056:0:12890:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1789061647.298083:0:12890:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789061647.298086:0:12890:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789061647.313226:0:6730:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789061647.313235:0:6730:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1789061647.313252:0:6730:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789061647.314149:0:12890:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789061647.314155:0:12890:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789061647.314178:0:12890:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789061647.314181:0:12890:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789061647.314461:0:8021:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789061647.314467:0:8021:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789061647.314476:0:8021:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789061647.419530:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a46e 00000020:00000080:0.0:1789061647.419545:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a76188800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789061647.419979:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a76188800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789061647.423874:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a483 00000020:00000080:0.0:1789061647.423995:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a761ad800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789061647.424011:0:12890:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789061647.424016:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061647.424024:0:12890:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789061647.424029:0:12890:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff971a761a3380) has no exports 00000004:01000000:0.0:1789061647.426057:0:12890:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789061647.426073:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a6c1 00000020:00000080:0.0:1789061647.426081:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a7c2fc000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789061647.426090:0:12890:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789061647.426098:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061647.426108:0:12890:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789061647.426112:0:12890:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff971a760a8000) has no exports 00000020:00000080:0.0:1789061647.426120:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a6ba 00000020:00000080:0.0:1789061647.426124:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a7cb42800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789061647.426251:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a761ad800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789061647.426262:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a7c2fc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789061647.426266:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a7cb42800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789061647.427306:0:12890:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789061647.427313:0:12890:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789061647.427317:0:12890:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1789061647.427326:0:12890:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789061647.427329:0:12890:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789061647.427513:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061647.427524:0:12890:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789061647.427535:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a5da 00000020:00000080:0.0:1789061647.427543:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a65069000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789061647.428009:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a7cb44800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789061647.428018:0:8:0:(genops.c:885:class_export_put()) final put ffff971a7c2fd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789061647.428021:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a7c2fd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789061647.428027:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789061647.428250:0:12890:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789061647.428257:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061647.428264:0:12890:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789061647.428268:0:12890:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff971a7c733380) has no exports 00000020:00000080:0.0:1789061647.428284:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a5d3 00000020:00000080:0.0:1789061647.428288:0:12890:0:(genops.c:885:class_export_put()) final put ffff971944ffb800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789061647.430482:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a65069000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789061647.430695:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971944ffb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789061647.431052:0:12890:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789061647.431057:0:12890:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789061647.431062:0:12890:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789061647.431067:0:12890:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789061647.431069:0:12890:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789061647.431117:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061647.431126:0:12890:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789061647.431264:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061647.431269:0:12890:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789061647.431274:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a76189800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789061647.431277:0:12890:0:(genops.c:844:class_export_destroy()) destroying export ffff971a76189800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789061647.431282:0:12890:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789061647.431469:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a48a 00000020:00000080:0.0:1789061647.431476:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a761ad000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789061647.431481:0:12890:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789061647.431700:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061647.431706:0:12890:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789061647.431710:0:12890:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff971a761a4d40) has no exports 00000020:00000080:0.0:1789061647.431729:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061647.431732:0:12890:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789061647.431738:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a491 00000020:00000080:0.0:1789061647.431743:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a761aa000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789061647.431750:0:12890:0:(tgt_mount.c:187:server_put_mount()) put mount ffff971a46ca8000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789061647.431753:0:12890:0:(obd_mount.c:710:lustre_put_lsi()) put ffff971a46ca8000 3 00000020:01000004:0.0:1789061647.431756:0:12890:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff971a46ca8000 from lustre-MDT0000 00000020:00000080:0.0:1789061647.431772:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061647.431776:0:12890:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789061647.431778:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a76188000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789061647.431781:0:12890:0:(genops.c:844:class_export_destroy()) destroying export ffff971a76188000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789061647.431788:0:12890:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789061647.431840:0:12890:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789061647.431843:0:12890:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789061647.431846:0:12890:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789061647.431849:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061647.431851:0:12890:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789061647.431857:0:12890:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff971a428ad000 24dfd7ac-7455-4043-9449-a564380782df 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789061647.431862:0:12890:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff971a4d664d40) has exports, disconnecting them 00000020:00080000:0.0:1789061647.431866:0:12890:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff971a428ad000), last request at 1789061406 00000020:00000080:0.0:1789061647.431880:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a42f 00000020:00010000:0.0:1789061647.432126:0:12890:0:(genops.c:1920:obd_stale_export_put()) Put export ffff971a428ad000: total 2 00000100:00080000:0.0:1789061647.432133:0:12890:0:(import.c:65:import_set_state_nolock()) ffff971a428ad800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789061647.432156:0:12890:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff971a428ad000): rc 0 00000020:00080000:0.0:1789061647.432160:0:12890:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff971a4d664d40) has no exports 00000100:00100000:0.0:1789061647.432213:0:5845:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff971a44c8ce00:5845] 2 exiting: rc = 0 00000100:00100000:0.0:1789061647.432295:0:5844:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff971a4f709000:5844] 1 exiting: rc = 0 00000020:00010000:3.0:1789061647.432370:0:5838:0:(genops.c:1906:obd_stale_export_get()) Get export ffff971a428ad000: total 2 00010000:00010000:3.0:1789061647.432401:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff971a428ad000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1789061647.432425:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41477800/0x427fa11dc4a9a976 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a96f expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061647.432441:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9a75b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a754 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061647.432452:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a40031000/0x427fa11dc4a9a547 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a540 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061647.432467:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63f600/0x427fa11dc4a9a785 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a77e expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061647.432524:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9a984 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a97d expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061647.432537:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7596d400/0x427fa11dc4a9a731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a72a expref: 4 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061647.432546:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a41477e00/0x427fa11dc4a9a73f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a738 expref: 3 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061647.432555:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7596c800/0x427fa11dc4a9a74d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x427fa11dc4a9a746 expref: 2 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061647.432567:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff971a428ad000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1789061647.432579:0:5838:0:(genops.c:885:class_export_put()) final put ffff971a428ad000/24dfd7ac-7455-4043-9449-a564380782df 00010000:00010000:3.0:1789061647.432584:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061647.432586:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061647.432588:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061647.432623:0:5843:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff971a4f708600:5843] 0 exiting: rc = 1 00000100:00100000:0.0:1789061647.432850:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432858:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432864:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432870:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432876:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432882:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432898:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432905:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432911:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432917:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432923:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432929:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432934:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432940:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432945:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432950:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432957:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432962:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432977:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432983:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432989:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.432995:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433000:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433005:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433010:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433015:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433019:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433024:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433029:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433035:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433040:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433045:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433050:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433056:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433060:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433064:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433070:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433075:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433080:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433085:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433090:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433094:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433099:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433104:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433109:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433115:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433120:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433125:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433135:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433315:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433325:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433371:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433378:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433393:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433399:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433406:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433413:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433420:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433426:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433432:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433437:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433442:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433447:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061647.433452:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1789061647.433967:0:12890:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789061647.433971:0:12890:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1789061647.434271:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971944fff000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789061647.434282:0:8:0:(genops.c:885:class_export_put()) final put ffff971944ffa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789061647.434285:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971944ffa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789061647.434290:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789061647.434404:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a761ad000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789061647.434408:0:8:0:(genops.c:885:class_export_put()) final put ffff971a76189000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789061647.434410:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a76189000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789061647.434413:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789061647.434584:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a761aa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789061647.434590:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971a428ad000/24dfd7ac-7455-4043-9449-a564380782df for MGS 00000020:00000080:1.0:1789061647.434636:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a428ad800 for MGS 00000020:01000000:0.0:1789061647.437008:0:12890:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff971a485d4ea0 - data ffff971a4dfb4ca8/ffff971944760c00 00000020:01000000:0.0:1789061647.437139:0:12890:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff971a46d234e0 - data ffff971a4dc1f948/ffff971a44b72800 00000020:00000080:0.0:1789061647.437964:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a413 00000020:00000080:0.0:1789061647.437974:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a4858e800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789061647.438030:0:12890:0:(tgt_mount.c:187:server_put_mount()) put mount ffff971a46ca8000 from MGS, refs=2 00000020:01000004:0.0:1789061647.438034:0:12890:0:(obd_mount.c:710:lustre_put_lsi()) put ffff971a46ca8000 2 00000020:01000004:0.0:1789061647.438038:0:12890:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff971a46ca8000 from MGS 00000020:00000080:0.0:1789061647.438066:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061647.438072:0:12890:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789061647.438075:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a46cae800/MGS 00000020:00000080:0.0:1789061647.438077:0:12890:0:(genops.c:844:class_export_destroy()) destroying export ffff971a46cae800/MGS for MGS 00000020:01000000:0.0:1789061647.438086:0:12890:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789061647.438158:0:12890:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789061647.438163:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061647.438168:0:12890:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789061647.438174:0:12890:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff971a7c2f8800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789061647.438181:0:12890:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff971a47d63380) has exports, disconnecting them 00000020:00080000:0.0:1789061647.438186:0:12890:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff971a7c2f8800), last request at 1789061407 00000020:00000080:0.0:1789061647.438190:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a4de 00000020:00080000:0.0:1789061647.438216:0:12890:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff971a7c2f8800): rc 0 00000020:00000080:0.0:1789061647.438221:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a7c2f8800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789061647.438796:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a4858e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789061647.440003:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a7c2f8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789061647.443640:0:12890:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789061647.443649:0:12890:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789061647.443653:0:12890:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789061647.443661:0:12890:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789061647.443848:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789061647.443856:0:12890:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789061647.443863:0:12890:0:(obd_mount.c:710:lustre_put_lsi()) put ffff971a46ca8000 1 00000020:00000080:1.0:1789061647.443870:0:12890:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a405 00000020:00000080:1.0:1789061647.443878:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a46caf000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789061647.443891:0:12890:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789061647.443896:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789061647.443899:0:12890:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789061647.443903:0:12890:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff971a4d6619c0) has no exports 00000020:00000080:3.0:1789061647.447014:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a7c2fa000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789061647.447030:0:36:0:(genops.c:885:class_export_put()) final put ffff971a7c2d8800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789061647.447034:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a7c2d8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789061647.447046:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789061647.447112:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a46caf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789061647.518661:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789061647.518677:0:12890:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789061647.518684:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a46cac000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789061647.518703:0:12890:0:(genops.c:844:class_export_destroy()) destroying export ffff971a46cac000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789061647.518717:0:12890:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789061647.518880:0:12890:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff971a46cad000 00000020:01000000:3.0:1789061647.518905:0:12890:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789061647.518911:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789061647.518915:0:12890:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789061647.518919:0:12890:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff971a47d60000) has no exports 00000100:00100000:3.0:1789061647.518996:0:5852:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff971a4e62d200:5852] 1 exiting: rc = 0 00000100:00100000:3.0:1789061647.519112:0:5851:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff971a4f728e00:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1789061647.519758:0:5853:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff971a4e62cc00:5853] 2 exiting: rc = 0 00000100:00100000:1.0:1789061647.521979:0:8391:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff971a75b21200:8391] 3 exiting: rc = 0 00000100:00100000:3.0:1789061647.523551:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523563:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523568:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523574:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523579:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523585:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523606:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523613:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523619:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523625:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523631:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523638:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523643:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523649:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523656:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523661:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523666:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523672:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523677:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523682:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523687:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523692:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523697:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523702:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523708:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523736:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523743:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523748:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523754:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523759:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523765:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523771:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523776:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523782:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523790:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523795:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523799:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523805:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523810:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523817:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523823:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523840:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523846:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523852:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523859:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523865:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523871:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523877:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523884:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523889:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523895:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523900:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523905:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523910:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523915:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523921:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523925:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523931:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523938:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523943:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523957:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523963:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523969:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.523974:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.532952:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff971a56fa1000:5854] 0 exiting: rc = 1 00000100:00100000:0.0:1789061647.533912:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff971a56fa0400:5855] 1 exiting: rc = 0 00000100:00100000:3.0:1789061647.534057:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534067:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534074:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534080:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534086:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534092:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534098:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534103:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534110:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534116:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534121:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534128:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534134:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534139:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534151:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534157:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534162:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534167:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534172:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534177:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534182:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534186:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534191:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534196:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534201:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534206:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534222:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534227:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534233:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534238:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534243:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534258:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534264:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534269:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534274:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534280:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534285:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534290:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534296:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534301:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534306:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534311:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534315:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534319:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534324:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534330:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534335:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534342:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534347:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534353:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534358:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534364:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534369:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534375:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534380:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534385:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534390:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534395:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534401:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534406:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534412:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534417:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534422:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.534426:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.535113:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff971a65066a00:5857] 1 exiting: rc = 0 00000100:00100000:1.0:1789061647.535559:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff971a65066400:5856] 0 exiting: rc = 1 00000100:00100000:3.0:1789061647.535715:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535723:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535742:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535748:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535755:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535762:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535769:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535775:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535794:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535803:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535808:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535816:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535823:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535839:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535845:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535852:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535858:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535864:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535870:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535877:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535899:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535907:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535913:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535919:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535924:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535931:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535937:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535942:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535948:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535955:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535961:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535967:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535989:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.535996:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536002:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536008:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536013:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536027:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536033:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536039:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536044:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536049:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536054:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536061:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536081:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536089:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536095:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536101:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536107:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536113:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536120:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536126:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536131:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536137:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536276:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536283:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536303:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536310:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536316:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536321:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536328:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536333:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536341:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.536346:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.547615:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff971a65067200:5858] 0 exiting: rc = 1 00000100:00100000:3.0:1789061647.547802:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff971a65066200:5859] 1 exiting: rc = 0 00000100:00100000:1.0:1789061647.548168:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548175:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548180:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548186:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548191:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548196:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548201:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548217:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548223:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548228:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548233:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548251:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548256:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548261:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548267:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548271:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548277:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548282:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548288:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548294:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548299:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548305:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548311:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548316:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548322:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548327:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548336:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548342:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548348:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548354:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548359:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548365:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548370:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548376:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548382:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548388:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548393:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548398:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548404:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548410:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548415:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548421:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548426:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548432:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548436:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548442:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548457:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548463:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548469:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548474:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548479:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548508:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548515:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548520:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548525:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548531:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548537:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548543:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548548:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548552:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548557:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548562:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548567:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.548573:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061647.549458:0:5861:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff971a65067400:5861] 1 exiting: rc = 0 00000100:00100000:0.0:1789061647.549968:0:5860:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff971a65067a00:5860] 0 exiting: rc = 1 00000100:00100000:1.0:1789061647.550085:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550092:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550097:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550102:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550107:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550112:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550117:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550122:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550127:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550132:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550138:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550153:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550159:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550164:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550169:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550174:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550180:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550195:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550200:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550213:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550219:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550224:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550230:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550235:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550240:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550245:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550249:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550254:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550260:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550266:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550270:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550275:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550280:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550285:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550290:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550295:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550300:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550306:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550311:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550316:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550322:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550328:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550333:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550339:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550345:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550351:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550357:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550363:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550368:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550375:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550380:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550386:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550399:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550405:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550411:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550416:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550421:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550426:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550432:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550437:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550442:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550447:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550453:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550459:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550873:0:5862:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff971a65066e00:5862] 0 exiting: rc = 1 00000100:00100000:1.0:1789061647.550929:0:5863:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff971a65067600:5863] 1 exiting: rc = 0 00000100:00100000:1.0:1789061647.550973:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550979:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550985:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550990:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.550996:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551001:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551007:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551012:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551017:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551022:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551027:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551032:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551037:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551043:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551048:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551054:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551060:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551066:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551072:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551077:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551082:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551097:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551102:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551107:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551112:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551117:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551122:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551129:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551135:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551139:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551144:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551149:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551155:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551159:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551164:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551169:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551174:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551179:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551185:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551190:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551195:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551199:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551204:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551210:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551216:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551221:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551227:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551232:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551237:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551241:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551246:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551251:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551255:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551261:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551265:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551269:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551281:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551286:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551291:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551296:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551301:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551306:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551311:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551317:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.551755:0:5864:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff971a56fa1600:5864] 0 exiting: rc = 1 00000100:00100000:1.0:1789061647.551907:0:5865:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff971a56fa1800:5865] 1 exiting: rc = 0 00000100:00100000:1.0:1789061647.552053:0:5866:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff971a4d640a00:5866] 2 exiting: rc = 0 00000100:00100000:1.0:1789061647.552103:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552109:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552122:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552128:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552133:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552139:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552143:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552148:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552153:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552158:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552163:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552168:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552173:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552177:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552182:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552187:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552193:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552199:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552204:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552212:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552218:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552224:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552229:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552235:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552251:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552257:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552275:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552282:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552286:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552291:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552297:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552303:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552308:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552314:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552321:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552326:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552331:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552337:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552343:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552348:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552353:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552358:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552364:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552369:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552375:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552380:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552386:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552392:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552398:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552404:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552424:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552430:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552435:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552440:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552445:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552450:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552456:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552461:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552466:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552478:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552483:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552511:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552516:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061647.552520:0:12890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789061647.559393:0:12890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789061647.559407:0:12890:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789061647.559414:0:12890:0:(genops.c:885:class_export_put()) final put ffff971a48538000/MDS_uuid 00000020:00000080:1.0:1789061647.559418:0:12890:0:(genops.c:844:class_export_destroy()) destroying export ffff971a48538000/MDS_uuid for MDS 00000020:01000000:1.0:1789061647.559424:0:12890:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789061647.559589:0:12890:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789061648.257234:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061649.154061:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061649.154085:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779546368:0@lo:400:kworker.0 00000400:00000100:0.0:1789061649.154141:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875966779546368 offset 0 length 224: 4 00000100:00100000:2.0:1789061649.154258:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779546240:0@lo:400:kworker.0 00000100:00100000:1.0:1789061649.154812:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779546112:0@lo:400:kworker.0 00000400:00000100:1.0:1789061649.156042:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875966779546112 offset 0 length 224: 4 00000400:00000100:2.0:1789061649.156370:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875966779546240 offset 0 length 224: 4 00010000:00010000:2.0:1789061649.280752:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789061649.744062:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789061649.744076:0:6725:0:(genops.c:885:class_export_put()) final put ffff971944d9e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789061649.744216:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff971944d9e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789061649.744288:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971944d9a000 for lustre-OST0000 00010000:00010000:1.0:1789061650.301693:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789061651.304518:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789061651.304528:0:7660:0:(genops.c:885:class_export_put()) final put ffff971a68187000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789061651.304559:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a68187000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789061651.304600:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a68186000 for lustre-OST0001 00010000:00010000:2.0:1789061651.333604:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789061651.740453:0:13043:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789061651.767250:0:13043:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789061651.767302:0:13043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061651.767319:0:13043:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061651.767327:0:13043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061651.767334:0:13043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061651.767360:0:13043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789061651.767365:0:13043:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789061651.767393:0:13043:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789061651.767405:0:13043:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff971947e4b800 x1875966779546240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061665 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061651.767421:0:13043:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789061651.767442:0:13043:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789061651.767470:0:13043:0:(import.c:65:import_set_state_nolock()) ffff971945059000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789061651.767580:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875966779546496:0@lo:39:umount.0 00000400:00000100:2.0:1789061651.767640:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875966779546496 offset 0 length 224: 4 00010000:00010000:3.0:1789061651.768258:0:8477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061651.768267:0:8477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061651.768295:0:8477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ec00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1789061651.768299:0:8477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061651.768307:0:8477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061651.768314:0:8477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061651.768320:0:8477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789061651.768323:0:8477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789061651.768326:0:8477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789061651.768353:0:8477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061651.768359:0:8477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061651.768386:0:8477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061651.768393:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4f63ec00/0x427fa11dc4a9a746 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x427fa11dc4a9a74d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061651.768408:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061651.768410:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061651.768411:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061651.768418:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061651.768428:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779546624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061651.768465:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061651.769138:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779546240:0@lo:400:kworker.0 00000100:00100000:1.0:1789061651.769171:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779546624 00000100:00100000:1.0:1789061651.769179:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779546624 00000100:00100000:1.0:1789061651.769223:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789061651.769231:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1875966779546624:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789061651.769237:0:5837:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789061651 with bad export cookie 4791725677771072559 00000100:00100000:0.0:1789061651.790613:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1875966779546624:12345-0@lo:103:ldlm_bl.0 Request processed in 21371us (22136us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789061651.790631:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789061651.791276:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789061651.791283:0:3312:0:(import.c:65:import_set_state_nolock()) ffff971a4853e000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789061651.791287:0:3312:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1789061651.804515:0:3312:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.154@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789061651.804522:0:3312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789061651.804532:0:3312:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff971947e49880 x1875966779546112/t0(0) o400->MGC192.168.204.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789061665 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061651.804558:0:3312:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff971946bd1f80 x1875966779546624/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789061667 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789061651.804568:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789061651.804571:0:3312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789061651.804572:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789061651.804575:0:3312:0:(import.c:65:import_set_state_nolock()) ffff971a4853e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789061651.804580:0:3312:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 180 00000100:00080000:3.0:1789061651.804596:0:3312:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import ffff971a4853e000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789061651.804778:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24dfd7ac-7455-4043-9449-a564380782df:3310:1875966779546112:0@lo:400:kworker.0 00000100:00100000:2.0:1789061651.804838:0:3312:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971946cded80 x1875966779546752/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789061651.804862:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:24dfd7ac-7455-4043-9449-a564380782df:3312:1875966779546624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061651.805887:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:24dfd7ac-7455-4043-9449-a564380782df:3309:1875966779546752:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1789061651.806170:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875966779546752 offset 0 length 520: 4 00010000:00010000:2.0:1789061652.352389:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061653.373585:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789061654.269691:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 24dfd7ac-7455-4043-9449-a564380782df->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789061654.269716:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 24dfd7ac-7455-4043-9449-a564380782df->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789061654.270005:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875966779546880:0@lo:400:kworker.0 00000400:00000100:2.0:1789061654.270238:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875966779546880 offset 0 length 224: 4 00010000:00010000:2.0:1789061654.400509:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061655.421770:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061656.449631:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789061657.278814:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 24dfd7ac-7455-4043-9449-a564380782df->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789061657.278825:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 24dfd7ac-7455-4043-9449-a564380782df->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789061657.278965:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779547008:0@lo:400:kworker.0 00000400:00000100:2.0:1789061657.279023:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875966779547008 offset 0 length 224: 4 00010000:00010000:1.0:1789061657.470819:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061658.494642:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061659.518416:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061660.541811:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061661.565837:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061661.952124:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789061651/real 1789061651] req@ffff971946cded80 x1875966779546752/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789061661 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061661.952167:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff971946cded80 x1875966779546752/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789061661 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061661.952177:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789061651/real 1789061651] req@ffff971947e49180 x1875966779546496/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789061661 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061661.952192:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff971947e49180 x1875966779546496/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789061661 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789061661.952237:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971a4853e000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789061661.952264:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789061661.952270:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:24dfd7ac-7455-4043-9449-a564380782df:3309:1875966779546752:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1789061661.952277:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971945059000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789061661.952292:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875966779546496:0@lo:39:umount.0 00000100:00080000:0.0:1789061661.952919:0:13043:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789061661.952927:0:13043:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789061661.952933:0:13043:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789061661.954663:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 24dfd7ac-7455-4043-9449-a564380782df->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789061661.954677:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789061661.954682:0:36:0:(import.c:65:import_set_state_nolock()) ffff971a4853e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789061661.954692:0:36:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 426 00000100:00080000:2.0:1789061661.954700:0:36:0:(import.c:630:import_select_connection()) MGC192.168.204.154@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789061661.954716:0:36:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import ffff971a4853e000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789061661.954761:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971946cded80 x1875966779547136/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789061661.954874:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061661.954891:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779547264:0@lo:400:kworker.0 00000400:00000100:2.0:1789061661.954976:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875966779547264 offset 0 length 224: 4 00010000:00010000:0.0:1789061661.956396:0:13043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061661.956426:0:13043:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061661.956435:0:13043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061661.956442:0:13043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061661.956479:0:13043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789061661.958275:0:13043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061661.958298:0:13043:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061661.958333:0:13043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061661.958339:0:13043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061661.958384:0:13043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789061661.958392:0:13043:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789061661.958439:0:13043:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789061661.958444:0:13043:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789061661.958451:0:13043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061661.958459:0:13043:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789061661.958464:0:13043:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff971a4d663380) has no exports 00000020:00080000:0.0:1789061661.958523:0:13043:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff971a4d663380) has no exports 00010000:00010000:1.0:1789061661.959653:0:8477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789061661.959670:0:8477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061661.959683:0:8477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476000 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061661.959688:0:8477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061661.959699:0:8477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061661.959708:0:8477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061661.959714:0:8477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789061661.959717:0:8477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789061661.959721:0:8477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789061661.959741:0:8477:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff971a4853e000 00010000:00010000:1.0:1789061661.959745:0:8477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061661.959751:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a41476000/0x427fa11dc4a9a754 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x427fa11dc4a9a75b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061661.959777:0:8477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061661.959781:0:8477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061661.959786:0:8477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061661.959789:0:8477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061661.959815:0:8477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061661.959821:0:8477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061661.959826:0:8477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789061661.959828:0:8477:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789061661.959830:0:8477:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789061661.959836:0:8477:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff971a4853e000 00010000:00010000:1.0:1789061661.959839:0:8477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061661.959844:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a7c524400/0x427fa11dc4a9a97d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x427fa11dc4a9a984 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061661.959854:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061661.959855:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061661.959857:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061661.959950:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:24dfd7ac-7455-4043-9449-a564380782df:3309:1875966779547136:0@lo:250:kworker.0 00000400:00000100:3.0:1789061661.960024:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875966779547136 offset 0 length 520: 4 00010000:00010000:2.0:1789061661.960477:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789061661.968351:0:13043:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff971a7d22ee40 - data ffff971a4dc8b000/ffff971a7caff000 00000020:01000000:0.0:1789061661.971529:0:13043:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff971a4d7ca4e0 - data ffff971a4df50e58/ffff97194503c800 00100000:10000000:0.0:1789061661.982409:0:13043:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789061662.020646:0:13043:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a563 00000020:00000080:2.0:1789061662.020659:0:13043:0:(genops.c:885:class_export_put()) final put ffff971944d9d000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789061662.020729:0:13043:0:(tgt_mount.c:187:server_put_mount()) put mount ffff971a7618e800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789061662.020734:0:13043:0:(obd_mount.c:710:lustre_put_lsi()) put ffff971a7618e800 2 00000020:01000004:2.0:1789061662.020738:0:13043:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff971a7618e800 from lustre-OST0000 00000020:00000080:2.0:1789061662.020771:0:13043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789061662.020783:0:13043:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789061662.020787:0:13043:0:(genops.c:885:class_export_put()) final put ffff971944d9f000/lustre-OST0000_UUID 00000020:00000080:2.0:1789061662.020790:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff971944d9f000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789061662.020801:0:13043:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789061662.021010:0:13043:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789061662.021017:0:13043:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789061662.021022:0:13043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789061662.021028:0:13043:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789061662.021037:0:13043:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff97194505f000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789061662.021044:0:13043:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9719450519c0) has exports, disconnecting them 00000020:00080000:2.0:1789061662.021051:0:13043:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff97194505f000), last request at 1789061426 00000020:00000080:2.0:1789061662.021055:0:13043:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a58d 00000020:00080000:2.0:1789061662.021067:0:13043:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97194505f000): rc 0 00000020:00000080:2.0:1789061662.021075:0:13043:0:(genops.c:885:class_export_put()) final put ffff97194505f000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789061662.024569:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971944d9d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789061662.024952:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97194505f000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789061662.029606:0:13043:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789061662.029619:0:13043:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789061662.029626:0:13043:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789061662.029636:0:13043:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789061662.029897:0:13043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061662.029910:0:13043:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789061662.029921:0:13043:0:(obd_mount.c:710:lustre_put_lsi()) put ffff971a7618e800 1 00000020:00000080:0.0:1789061662.029930:0:13043:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a51d 00000020:00000080:0.0:1789061662.029942:0:13043:0:(genops.c:885:class_export_put()) final put ffff971a4e223000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789061662.029949:0:13043:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789061662.029961:0:13043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061662.029966:0:13043:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789061662.029990:0:13043:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff971a4d660000) has no exports 00000020:00000080:1.0:1789061662.030162:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971945059000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789061662.030171:0:36:0:(genops.c:885:class_export_put()) final put ffff971a68181000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789061662.030174:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a68181000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789061662.030182:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789061662.030251:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a4e223000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789061662.058155:0:13043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789061662.058176:0:13043:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789061662.058202:0:13043:0:(genops.c:885:class_export_put()) final put ffff971a47d5c000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789061662.058208:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff971a47d5c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789061662.058223:0:13043:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789061662.058396:0:13043:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff971a47d5d800 00000020:02000400:1.0:1789061662.058448:0:13043:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789061662.589736:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061663.614884:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061664.639591:0:8477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1789061665.022631:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789061649/real 1789061649] req@ffff971947e4b100 x1875966779546368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789061665 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061665.053846:0:3313:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff971947e4b100 x1875966779546368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789061665 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789061665.053866:0:3313:0:(import.c:65:import_set_state_nolock()) ffff971944d05800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789061665.053879:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789061665.067573:0:3313:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:2.0:1789061665.067628:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779546368:0@lo:400:kworker.0 00000100:00080000:0.0:1789061665.068550:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 24dfd7ac-7455-4043-9449-a564380782df->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789061665.068557:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 24dfd7ac-7455-4043-9449-a564380782df->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789061665.068560:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789061665.068563:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789061665.068568:0:36:0:(import.c:65:import_set_state_nolock()) ffff971944d05800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789061665.068576:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 221 00000100:00080000:0.0:1789061665.069007:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff971944d05800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789061665.069058:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971947e4b800 x1875966779547392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789061665.070608:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875966779547392:0@lo:38:kworker.0 00000400:00000100:1.0:1789061665.070698:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875966779547392 offset 0 length 520: 4 00000020:01000004:1.0:1789061665.265975:0:13197:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789061665.279701:0:13197:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789061665.279869:0:13197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061665.279889:0:13197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061665.279898:0:13197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061665.279906:0:13197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061665.279931:0:13197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789061665.279937:0:13197:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789061665.279965:0:13197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789061665.279981:0:13197:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff971947e49880 x1875966779546880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061670 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061665.280016:0:13197:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9719453e6300 x1875966779547008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061673 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061665.280033:0:13197:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff971946cdd500 x1875966779547264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061677 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061665.280048:0:13197:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff971947e4b800 x1875966779547392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789061675 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061665.280060:0:13197:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1789061665.280121:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779547008:0@lo:400:kworker.0 00000100:00100000:2.0:1789061665.280164:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875966779547264:0@lo:400:kworker.0 00000100:00080000:2.0:1789061665.280184:0:13197:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789061665.280192:0:13197:0:(import.c:65:import_set_state_nolock()) ffff971944d05800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789061665.280199:0:13197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789061665.280204:0:13197:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff971947e49880 x1875966779546880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061670 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061665.280212:0:13197:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff971947e4b800 x1875966779547392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789061675 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061665.280218:0:13197:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789061665.280222:0:13197:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00010000:00010000:1.0:1789061665.280301:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061665.280311:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061665.280320:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc84000 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1789061665.280324:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061665.280334:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061665.280342:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061665.280348:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789061665.280351:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789061665.280353:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789061665.280372:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff971a4853e000 00010000:00010000:1.0:1789061665.280375:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061665.280395:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4cc84000/0x427fa11dc4a9a72a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x427fa11dc4a9a731 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061665.280410:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061665.280411:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061665.280413:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061665.280437:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875966779547392:0@lo:38:kworker.0 00000100:00100000:3.0:1789061665.281077:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875966779546880:0@lo:400:kworker.0 00010000:00010000:2.0:1789061665.282473:0:13197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061665.282539:0:13197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061665.282547:0:13197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061665.282554:0:13197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061665.282583:0:13197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061665.282592:0:13197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061665.282598:0:13197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061665.282620:0:13197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061665.282627:0:13197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061665.282646:0:13197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789061665.282652:0:13197:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789061665.282681:0:13197:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789061665.282686:0:13197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789061665.282692:0:13197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789061665.282699:0:13197:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789061665.282704:0:13197:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff971a7c7319c0) has no exports 00000020:00080000:2.0:1789061665.282734:0:13197:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff971a7c7319c0) has no exports 00010000:00010000:0.0:1789061665.284442:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789061665.284458:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061665.284473:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4cc85400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061665.284477:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061665.284528:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061665.284538:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061665.284544:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789061665.284547:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789061665.284550:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789061665.284572:0:5839:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff971a4853e000 00010000:00010000:0.0:1789061665.284596:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061665.284603:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4cc85400/0x427fa11dc4a9a738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x427fa11dc4a9a73f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061665.284623:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061665.284627:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061665.284632:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d000 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061665.284635:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061665.284642:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061665.284648:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061665.284654:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789061665.284656:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789061665.284658:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789061665.284665:0:5839:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff971a4853e000 00010000:00010000:0.0:1789061665.284668:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061665.284674:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9a96f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x427fa11dc4a9a976 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061665.284692:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061665.284701:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061665.284703:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061665.285177:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789061665.286995:0:13197:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff971a7d22e300 - data ffff971a4dc1e000/ffff971a7cafd400 00000020:01000000:0.0:1789061665.287213:0:13197:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff971a7ca96540 - data ffff971a7ff1c948/ffff971945f42400 00100000:10000000:2.0:1789061665.301330:0:13197:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789061665.345625:0:13197:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a62e 00000020:00000080:2.0:1789061665.345638:0:13197:0:(genops.c:885:class_export_put()) final put ffff971944ffd800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789061665.345654:0:13197:0:(tgt_mount.c:187:server_put_mount()) put mount ffff971a75aff800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789061665.345658:0:13197:0:(obd_mount.c:710:lustre_put_lsi()) put ffff971a75aff800 2 00000020:01000004:2.0:1789061665.345662:0:13197:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff971a75aff800 from lustre-OST0001 00000020:00000080:2.0:1789061665.345693:0:13197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789061665.345706:0:13197:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789061665.345709:0:13197:0:(genops.c:885:class_export_put()) final put ffff971944ffb000/lustre-OST0001_UUID 00000020:00000080:2.0:1789061665.345713:0:13197:0:(genops.c:844:class_export_destroy()) destroying export ffff971944ffb000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789061665.345721:0:13197:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789061665.345874:0:13197:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 24dfd7ac-7455-4043-9449-a564380782df->MGS 00010000:00010000:2.0:1789061665.345897:0:13197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9a540 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x427fa11dc4a9a547 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061665.345911:0:13197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9a540 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x427fa11dc4a9a547 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061665.345932:0:13197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789061665.345935:0:13197:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789061665.345939:0:13197:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789061665.345957:0:13197:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff971a4853e000 00010000:00010000:2.0:1789061665.345961:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9a540 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x427fa11dc4a9a547 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061665.345981:0:13197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4cc85800/0x427fa11dc4a9a77e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x427fa11dc4a9a785 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061665.345988:0:13197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4cc85800/0x427fa11dc4a9a77e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x427fa11dc4a9a785 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061665.345994:0:13197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789061665.345996:0:13197:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789061665.345998:0:13197:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789061665.346010:0:13197:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff971a4853e000 00010000:00010000:2.0:1789061665.346013:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4cc85800/0x427fa11dc4a9a77e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x427fa11dc4a9a785 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789061665.346031:0:13197:0:(import.c:65:import_set_state_nolock()) ffff971a4853e000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789061665.346035:0:13197:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789061665.346038:0:13197:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789061665.346039:0:13197:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789061665.346044:0:13197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789061665.346058:0:13197:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff971946cded80 x1875966779547136/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789061676 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789061665.346082:0:13197:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789061665.346085:0:13197:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000020:00000080:3.0:1789061665.346308:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971944ffd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1789061665.346741:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:24dfd7ac-7455-4043-9449-a564380782df:3309:1875966779547136:0@lo:250:kworker.0 10000000:01000000:2.0:1789061665.347022:0:13197:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789061665.347050:0:13197:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a421 00000020:00000080:2.0:1789061665.347058:0:13197:0:(genops.c:885:class_export_put()) final put ffff971a48538800/24dfd7ac-7455-4043-9449-a564380782df 00000020:01000000:2.0:1789061665.347108:0:13197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.154@tcp (flags='') 00000020:00000080:2.0:1789061665.347116:0:13197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789061665.347123:0:13197:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.154@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789061665.347128:0:13197:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff971a47d64d40) has no exports 10000000:01000000:1.0:1789061665.347191:0:5848:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789061665.347297:0:13197:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.154@tcp: client import never connected 00000100:00080000:2.0:1789061665.347301:0:13197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789061665.347304:0:13197:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789061665.347306:0:13197:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789061665.347308:0:13197:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789061665.349132:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a48538800/24dfd7ac-7455-4043-9449-a564380782df for MGC192.168.204.154@tcp 00000020:00000080:2.0:1789061665.349340:0:13197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789061665.349356:0:13197:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.154@tcp (uuid 24dfd7ac-7455-4043-9449-a564380782df) 00000020:01000000:2.0:1789061665.349368:0:13197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789061665.349378:0:13197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789061665.349385:0:13197:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789061665.349397:0:13197:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff971a4d7d6000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789061665.349405:0:13197:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff971a47d619c0) has exports, disconnecting them 00000020:00080000:2.0:1789061665.349412:0:13197:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff971a4d7d6000), last request at 1789061446 00000020:00000080:2.0:1789061665.349419:0:13197:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a658 00000020:00080000:2.0:1789061665.349442:0:13197:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff971a4d7d6000): rc 0 00000020:00000080:2.0:1789061665.349449:0:13197:0:(genops.c:885:class_export_put()) final put ffff971a4d7d6000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789061665.350174:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971a4853e000 for MGC192.168.204.154@tcp 00000020:00000080:3.0:1789061665.350189:0:36:0:(genops.c:885:class_export_put()) final put ffff971a4853c000/24dfd7ac-7455-4043-9449-a564380782df 00000020:00000080:3.0:1789061665.350192:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a4853c000/24dfd7ac-7455-4043-9449-a564380782df for MGC192.168.204.154@tcp 00000020:01000000:3.0:1789061665.350200:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.154@tcp (24dfd7ac-7455-4043-9449-a564380782df) 00000020:00000080:3.0:1789061665.351364:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a4d7d6000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789061665.355576:0:13197:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789061665.355589:0:13197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789061665.355594:0:13197:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789061665.355605:0:13197:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789061665.355764:0:8477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1789061665.356040:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff971944d05800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1789061665.356187:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789061665.356382:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1789061665.356558:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1789061665.357055:0:5834:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff971a45292200:5834] 1 exiting: rc = 0 00000100:00100000:3.0:1789061665.357171:0:8475:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff971a75b20600:8475] 2 exiting: rc = 0 00000100:00100000:3.0:1789061665.357326:0:5833:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff971a45293200:5833] 0 exiting: rc = 1 00000100:00100000:1.0:1789061665.357452:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061665.357962:0:7648:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff971a7ce84600:7648] 3 exiting: rc = 0 00000100:00100000:1.0:1789061665.358587:0:5835:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff971a45293a00:5835] 0 exiting: rc = 1 00000100:00100000:3.0:1789061665.358706:0:5836:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff971a4d348600:5836] 1 exiting: rc = 0 00000100:00100000:0.0:1789061665.364480:0:5837:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff971a45293400:5837] 2 exiting: rc = 0 00000100:00100000:1.0:1789061665.364920:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.364930:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.364938:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.364946:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.364953:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.364959:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.364965:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.364972:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.364979:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.364988:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.364995:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365001:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365008:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365014:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365039:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365046:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365053:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365061:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365067:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365072:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365078:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365084:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365089:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365095:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365101:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365106:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365111:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365117:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365122:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365127:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365132:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365138:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365145:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365151:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365156:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365163:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365169:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365175:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365182:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365188:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365193:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365199:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365205:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365212:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365218:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365223:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365228:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365234:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365240:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365255:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365261:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365280:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365288:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365294:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365300:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365306:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365312:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365317:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365323:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365329:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365336:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365342:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365347:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.365353:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789061665.367975:0:13197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789061665.367993:0:13197:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789061665.368001:0:13197:0:(genops.c:885:class_export_put()) final put ffff971a4d7d0800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789061665.368007:0:13197:0:(genops.c:844:class_export_destroy()) destroying export ffff971a4d7d0800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789061665.368015:0:13197:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1789061665.368079:0:13197:0:(obd_mount.c:710:lustre_put_lsi()) put ffff971a75aff800 1 00000020:00000080:1.0:1789061665.368087:0:13197:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x427fa11dc4a9a5fd 00000020:00000080:1.0:1789061665.368095:0:13197:0:(genops.c:885:class_export_put()) final put ffff971a4d7d5000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789061665.368118:0:13197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789061665.368124:0:13197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789061665.368130:0:13197:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789061665.368135:0:13197:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff971a7cbb0000) has no exports 00000020:00000080:3.0:1789061665.368456:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff971a4d7d5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789061665.420191:0:13197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789061665.420217:0:13197:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789061665.420225:0:13197:0:(genops.c:885:class_export_put()) final put ffff971a75afe800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789061665.420234:0:13197:0:(genops.c:844:class_export_destroy()) destroying export ffff971a75afe800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789061665.420265:0:13197:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789061665.420729:0:13197:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff971a75af8800 00000020:01000000:1.0:1789061665.420888:0:13197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789061665.420894:0:13197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789061665.420900:0:13197:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789061665.420906:0:13197:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff971a7c730000) has no exports 00000020:00000080:1.0:1789061665.420974:0:13197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789061665.420985:0:13197:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789061665.420989:0:13197:0:(genops.c:885:class_export_put()) final put ffff971a4e227000/OSS_uuid 00000020:00000080:1.0:1789061665.420992:0:13197:0:(genops.c:844:class_export_destroy()) destroying export ffff971a4e227000/OSS_uuid for OSS 00000020:01000000:1.0:1789061665.420996:0:13197:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789061665.421430:0:6701:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff971a4f739a00:6701] 1 exiting: rc = 0 00000100:00100000:1.0:1789061665.421601:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff971a7551f400:6699] 0 exiting: rc = 1 00000100:00100000:1.0:1789061665.423666:0:6702:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff971a7551e800:6702] 2 exiting: rc = 0 00000100:00080000:1.0:1789061665.423746:0:5846:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789061665.427699:0:8285:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff971945897a00:8285] 3 exiting: rc = 0 00000100:00100000:1.0:1789061665.428081:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428110:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428121:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428128:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428138:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428148:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428158:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428168:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428177:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428185:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428191:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428196:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428206:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428214:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428219:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428239:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428916:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428933:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428946:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428954:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428963:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.428973:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429004:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429014:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429021:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429028:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429038:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429046:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429052:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429061:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429070:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429077:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429083:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429090:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429099:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429108:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429114:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429123:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429133:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429139:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429147:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429155:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429163:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429170:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429175:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429182:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429191:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429199:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429204:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429209:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429215:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429225:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429257:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429272:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429283:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429293:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429302:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429318:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429327:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429336:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429345:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429353:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429360:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.429367:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061665.433790:0:6703:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff971a7749b000:6703] 0 exiting: rc = 1 00000100:00100000:0.0:1789061665.434983:0:6704:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff971a7749a800:6704] 1 exiting: rc = 0 00000100:00100000:1.0:1789061665.435097:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435117:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435123:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435129:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435137:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435144:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435151:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435157:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435163:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435170:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435175:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435181:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435187:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435194:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435201:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435207:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435213:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435219:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435240:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435250:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435257:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435263:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435268:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435273:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435279:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435285:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435291:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435297:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435354:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435359:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435365:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435371:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435409:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435420:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435429:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435439:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435446:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435452:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435458:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435465:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435470:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435477:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435483:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435530:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435536:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435541:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435547:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435553:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435558:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435564:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435570:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435588:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435595:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435601:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435607:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435763:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435771:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435777:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435783:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435789:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435795:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435931:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435940:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.435956:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.440938:0:6705:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff971a4d6a3800:6705] 0 exiting: rc = 1 00000100:00100000:2.0:1789061665.441372:0:6706:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff971a75920c00:6706] 1 exiting: rc = 0 00000100:00100000:0.0:1789061665.441735:0:6707:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff971a75920600:6707] 2 exiting: rc = 0 00000100:00100000:0.0:1789061665.442628:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442638:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442645:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442652:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442658:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442665:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442672:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442678:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442684:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442691:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442698:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442705:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442711:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442728:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442735:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442741:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442748:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442754:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442760:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442767:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442773:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442779:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442787:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442793:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442799:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442828:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442834:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442840:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442847:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442853:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442860:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442866:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442872:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442878:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442884:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442889:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442895:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442911:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442918:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442923:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442930:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442936:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442943:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442948:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442954:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442962:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442969:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442976:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442982:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442989:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.442995:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.443001:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.443007:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.443013:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.443019:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.443024:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.443031:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.443038:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.443044:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.443050:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.443061:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.443067:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.443073:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061665.443080:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061665.451418:0:6708:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff971a7cd88600:6708] 0 exiting: rc = 1 00000100:00100000:0.0:1789061665.451991:0:6709:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff971a7cd89000:6709] 1 exiting: rc = 0 00000100:00100000:1.0:1789061665.452161:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452172:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452178:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452184:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452189:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452195:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452202:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452209:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452216:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452222:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452228:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452234:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452241:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452247:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452253:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452259:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452264:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452270:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452276:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452283:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452288:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452293:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452299:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452306:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452312:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452318:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452324:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452330:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452336:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452341:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452348:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452354:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452361:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452382:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452388:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452394:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452400:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452405:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452411:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452417:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452422:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452428:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452433:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452438:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452443:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452447:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452452:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452458:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452463:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452468:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452473:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452478:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452483:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452752:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452760:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452768:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452774:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452780:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452787:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452793:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452798:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452859:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452865:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.452872:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.453879:0:6711:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff971a75920e00:6711] 1 exiting: rc = 0 00000100:00100000:2.0:1789061665.454081:0:6710:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff971a75921c00:6710] 0 exiting: rc = 1 00000100:00100000:1.0:1789061665.454282:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454291:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454299:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454321:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454329:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454337:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454346:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454353:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454377:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454385:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454393:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454399:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454406:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454412:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454419:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454426:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454432:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454438:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454444:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454451:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454469:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454476:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454483:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454520:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454527:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454534:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454541:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454548:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454556:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454562:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454577:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454584:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454608:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454749:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454757:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454763:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454770:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454776:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454794:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454812:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454821:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454830:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454837:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454844:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454858:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454879:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454887:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454894:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454901:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454909:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454918:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454927:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454935:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454942:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454949:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454958:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454968:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454989:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.454996:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.455003:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.455011:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.455018:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.455024:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061665.455036:0:13197:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789061665.481365:0:13197:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789061688.293377:0:13813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789061697.861115:0:14273:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789061697.861121:0:14273:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789061697.861234:0:14273:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97194517e000 00000020:01000004:3.0:1789061697.861250:0:14273:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789061697.861258:0:14273:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789061697.861274:0:14273:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff971a760ab380) 00000020:00000080:3.0:1789061697.861288:0:14273:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789061697.878786:0:14273:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789061697.880962:0:14273:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1789061697.884937:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1789061697.885115:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1789061697.885300:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1789061697.885480:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1789061697.885676:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1789061697.885888:0:14273:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789061697.885971:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1789061697.886920:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:1.0:1789061697.890731:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 590: rc = 0 00100000:10000000:1.0:1789061697.890993:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 590: rc = 0 00100000:10000000:1.0:1789061697.892142:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 27: rc = 0 00100000:10000000:1.0:1789061697.892683:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 27: rc = 0 00100000:10000000:1.0:1789061697.892953:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 27: rc = 0 00100000:10000000:1.0:1789061697.893201:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 27: rc = 0 00100000:10000000:1.0:1789061697.893752:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 27: rc = 0 00100000:10000000:1.0:1789061697.894011:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 27: rc = 0 00100000:10000000:1.0:1789061697.895455:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 27: rc = 0 00100000:10000000:1.0:1789061697.898928:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 27: rc = 0 00100000:10000000:1.0:1789061697.899249:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 27: rc = 0 00100000:10000000:1.0:1789061697.899664:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 27: rc = 0 00100000:10000000:1.0:1789061697.899933:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 27: rc = 0 00100000:10000000:1.0:1789061697.900187:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 27: rc = 0 00100000:10000000:1.0:1789061697.900749:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 50: rc = 0 00100000:10000000:1.0:1789061697.901015:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 50: rc = 0 00100000:10000000:1.0:1789061697.901379:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 50: rc = 0 00100000:10000000:1.0:1789061697.901725:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 50: rc = 0 00100000:10000000:1.0:1789061697.901990:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 50: rc = 0 00100000:10000000:1.0:1789061697.902318:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 50: rc = 0 00100000:10000000:1.0:1789061697.902610:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 50: rc = 0 00100000:10000000:1.0:1789061697.902859:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 50: rc = 0 00100000:10000000:1.0:1789061697.903176:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 50: rc = 0 00100000:10000000:1.0:1789061697.903943:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 50: rc = 0 00100000:10000000:1.0:1789061697.904300:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 50: rc = 0 00100000:10000000:1.0:1789061697.904573:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 50: rc = 0 00100000:10000000:1.0:1789061697.904819:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 50: rc = 0 00100000:10000000:1.0:1789061697.905068:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 50: rc = 0 00100000:10000000:1.0:1789061697.905397:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 50: rc = 0 00100000:10000000:1.0:1789061697.905758:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 50: rc = 0 00100000:10000000:1.0:1789061697.906021:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 50: rc = 0 00100000:10000000:1.0:1789061697.906365:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 50: rc = 0 00100000:10000000:1.0:1789061697.906660:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 50: rc = 0 00100000:10000000:1.0:1789061697.906913:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 50: rc = 0 00100000:10000000:1.0:1789061697.907336:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 50: rc = 0 00100000:10000000:1.0:1789061697.907620:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 50: rc = 0 00100000:10000000:1.0:1789061697.907885:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 50: rc = 0 00100000:10000000:1.0:1789061697.908119:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 50: rc = 0 00100000:10000000:1.0:1789061697.908630:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 50: rc = 0 00100000:10000000:1.0:1789061697.908909:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 50: rc = 0 00100000:10000000:1.0:1789061697.909172:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 50: rc = 0 00100000:10000000:1.0:1789061697.909531:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 50: rc = 0 00100000:10000000:1.0:1789061697.909779:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 50: rc = 0 00100000:10000000:1.0:1789061697.910052:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 50: rc = 0 00100000:10000000:1.0:1789061697.910436:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 50: rc = 0 00100000:10000000:1.0:1789061697.910715:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 50: rc = 0 00100000:10000000:1.0:1789061697.911094:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 370: rc = 0 00100000:10000000:1.0:1789061697.911786:0:14273:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1789061697.911954:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 648: rc = 0 00100000:10000000:1.0:1789061697.912152:0:14273:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1789061697.912296:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 648: rc = 0 00100000:10000000:1.0:1789061697.912516:0:14273:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1789061697.912580:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 648: rc = 0 00100000:10000000:1.0:1789061697.912921:0:14273:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1789061697.912991:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 591: rc = 0 00100000:10000000:1.0:1789061697.913177:0:14273:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1789061697.913323:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 591: rc = 0 00100000:10000000:1.0:1789061697.913616:0:14273:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1789061697.913683:0:14273:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 591: rc = 0 00000020:00000080:1.0:1789061697.913955:0:14273:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789061697.913966:0:14273:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789061697.913978:0:14273:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9b714 00000020:01000004:1.0:1789061697.913986:0:14273:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789061697.913991:0:14273:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789061697.913996:0:14273:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97194517e000 from MGS 00000020:01000004:1.0:1789061697.914000:0:14273:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789061697.914010:0:14273:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff971a7c733380) 00000020:00000080:1.0:1789061697.914021:0:14273:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789061697.914075:0:14273:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97194517e000 from MGS, refs=2 00080000:01000000:1.0:1789061697.914079:0:14273:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789061697.914083:0:14273:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9b722 00000100:00100000:1.0:1789061697.914179:0:14273:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789061697.914394:0:14273:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789061697.914401:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789061697.914966:0:14273:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789061697.914974:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789061697.915761:0:14273:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789061697.915935:0:14273:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789061697.915940:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789061697.916923:0:14273:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789061697.916934:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789061697.917345:0:14273:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789061697.917351:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789061697.918051:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061697.918055:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061697.918057:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061697.918356:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061697.918358:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061697.918359:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061697.918956:0:14273:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789061697.925374:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789061697.931168:0:14273:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789061697.931187:0:14273:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789061697.931190:0:14273:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789061697.934403:0:14282:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789061697.934592:0:14273:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789061697.934690:0:14273:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789061697.935199:0:14273:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789061697.936371:0:14273:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789061697.936628:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789061697.936635:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789061697.938283:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789061697.938294:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789061697.938901:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789061697.938910:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789061697.944106:0:14273:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789061697.944286:0:14273:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.154@tcp' 00000020:01000004:1.0:1789061697.944288:0:14273:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789061697.944322:0:14273:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.154@tcp (typ=mgc) 00000020:00000080:1.0:1789061697.944335:0:14273:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.154@tcp (ffff971a7c734d40) 00000020:00000080:1.0:1789061697.944351:0:14273:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789061697.944428:0:14273:0:(ldlm_lib.c:102:import_set_conn()) imp ffff971a47f6e800@MGC192.168.204.154@tcp: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1789061697.945083:0:14273:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.154@tcp-0 is initialized 00000040:01000000:1.0:1789061697.945092:0:14273:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789061697.945279:0:14287:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789061697.950281:0:14288:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789061697.950333:0:14273:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.154@tcp (uuid 3d02fbc9-0efc-41a2-bf6f-922e38501192) 00000020:00000080:1.0:1789061697.950355:0:14273:0:(genops.c:1384:class_connect()) connect: client 3d02fbc9-0efc-41a2-bf6f-922e38501192, cookie 0x427fa11dc4a9b730 00000100:00080000:1.0:1789061697.950368:0:14273:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789061697.950380:0:14273:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import ffff971a47f6e800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789061697.950418:0:14273:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9719453e7480 x1875966779547520/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789061697.950441:0:14273:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3d02fbc9-0efc-41a2-bf6f-922e38501192->MGS 00000020:01000004:1.0:1789061697.950460:0:14273:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789061697.950466:0:14273:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789061697.950482:0:14273:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff971a7c730000) 00000020:00000080:1.0:1789061697.950510:0:14273:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789061697.956777:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d02fbc9-0efc-41a2-bf6f-922e38501192:3309:1875966779547520:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789061697.956863:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061697.962937:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779547520 00000100:00100000:3.0:1789061697.962953:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779547520 00000100:00100000:3.0:1789061697.963000:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789061697.963009:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1875966779547520:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789061697.963036:0:14283:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 3d02fbc9-0efc-41a2-bf6f-922e38501192@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:3.0:1789061697.963062:0:14283:0:(genops.c:1384:class_connect()) connect: client 3d02fbc9-0efc-41a2-bf6f-922e38501192, cookie 0x427fa11dc4a9b73e 00000100:00080000:3.0:1789061697.963187:0:14283:0:(import.c:65:import_set_state_nolock()) ffff971945178800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061697.963287:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+5:3309:x1875966779547520:12345-0@lo:250:mount.lustre.0 Request processed in 278us (6423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061697.963294:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789061697.963333:0:3309:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789061697.963341:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.154@tcp: connect to target with instance 0 00000100:00080000:3.0:1789061697.963348:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789061697.963353:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789061697.963356:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971a47f6e800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789061697.963359:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00100000:1.0:1789061697.967051:0:14273:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789061697.967248:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789061697.967256:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789061697.970643:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789061697.970655:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00080000:3.0:1789061697.971834:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789061697.971853:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d02fbc9-0efc-41a2-bf6f-922e38501192:3309:1875966779547520:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789061697.975802:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789061697.975817:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789061697.977009:0:14273:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789061697.977383:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789061697.977390:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789061697.977907:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789061697.977914:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789061698.017297:0:14273:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789061698.017600:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789061698.017609:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789061698.018812:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789061698.018826:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789061698.019353:0:14273:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789061698.019790:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789061698.019797:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789061698.020238:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789061698.020246:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789061698.020925:0:14273:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789061698.021085:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789061698.021091:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789061698.021752:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789061698.021760:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789061698.022282:0:14273:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789061698.022425:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789061698.022430:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789061698.023100:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789061698.023108:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789061698.041914:0:14273:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789061698.042104:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789061698.042110:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789061698.046249:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789061698.046345:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789061698.047347:0:14273:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789061698.047358:0:14273:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789061698.050167:0:14273:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789061698.050192:0:14273:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789061698.050198:0:14273:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789061698.050329:0:14273:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789061698.050364:0:14273:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789061698.050369:0:14273:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789061698.050371:0:14273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789061698.050372:0:14273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061698.050374:0:14273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061698.050375:0:14273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061698.050376:0:14273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061698.050377:0:14273:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789061698.050379:0:14273:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789061698.050380:0:14273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061698.050382:0:14273:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789061698.050384:0:14273:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789061698.050386:0:14273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789061698.050387:0:14273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789061698.050388:0:14273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061698.050389:0:14273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061698.050390:0:14273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061698.050391:0:14273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061698.050392:0:14273:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789061698.050393:0:14273:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789061698.050394:0:14273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061698.050395:0:14273:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789061698.050424:0:14273:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789061698.050445:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779547648:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789061698.050765:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061698.050847:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a75b073c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061698.050911:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779547648 00000100:00100000:1.0:1789061698.050920:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779547648 00000100:00100000:1.0:1789061698.051005:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789061698.051016:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+5:14273:x1875966779547648:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789061698.051066:0:14286:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789061698.051070:0:14286:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789061698.051073:0:14286:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789061698.051379:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789061698.051994:0:14286:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1789061698.053023:0:14308:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789061698.053030:0:14308:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789061698.053032:0:14308:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789061698.053066:0:14308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789061698.053373:0:14286:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789061698.053385:0:14286:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789061698.064377:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+5:14273:x1875966779547648:12345-0@lo:253:mount.lustre.0 Request processed in 13351us (13599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061698.064394:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789061698.064651:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779547648:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789061698.064681:0:14273:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789061698.064684:0:14273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789061698.064686:0:14273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789061698.064688:0:14273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061698.064689:0:14273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061698.064691:0:14273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061698.064692:0:14273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061698.064694:0:14273:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789061698.064695:0:14273:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789061698.064698:0:14273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061698.064700:0:14273:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789061698.064805:0:14273:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97194517e000 from lustre-MDT0000 10000000:01000000:0.0:1789061698.064834:0:14273:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789061698.064837:0:14273:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789061698.064841:0:14273:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff971a7c734d40 10000000:01000000:0.0:1789061698.064845:0:14273:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789061698.064853:0:14273:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff971a7c734d40 from 1 10000000:01000000:0.0:1789061698.064855:0:14273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789061698.064905:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596c600/0x427fa11dc4a9b745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061698.064916:0:14273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7596c600/0x427fa11dc4a9b745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061698.064925:0:14273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7596c600/0x427fa11dc4a9b745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061698.064944:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779547776:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789061698.064982:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061698.065131:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cbf7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061698.066270:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779547776 00000100:00100000:2.0:1789061698.066281:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779547776 00000100:00100000:2.0:1789061698.066396:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061698.066408:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+5:14273:x1875966779547776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789061698.066424:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061698.066449:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63fe00/0x427fa11dc4a9b74c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b745 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.066533:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63fe00/0x427fa11dc4a9b74c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b745 expref: 6 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.066547:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63fe00/0x427fa11dc4a9b74c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b745 expref: 6 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.066557:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fe00, rc 0) 00000100:00100000:2.0:1789061698.066894:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+6:14273:x1875966779547776:12345-0@lo:101:mount.lustre.0 Request processed in 488us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061698.066902:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789061698.066963:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779547776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789061698.066983:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7596c600/0x427fa11dc4a9b745 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b74c expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061698.066994:0:14273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7596c600/0x427fa11dc4a9b745 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b74c expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061698.067086:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779547904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789061698.067132:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061698.067168:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cbf7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789061698.067241:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779547904 00000100:00100000:1.0:1789061698.067246:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779547904 00000100:00100000:1.0:1789061698.067284:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789061698.067292:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+6:14273:x1875966779547904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789061698.067549:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+6:14273:x1875966779547904:12345-0@lo:501:mount.lustre.0 Request processed in 257us (426us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789061698.067557:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789061698.067635:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779547904:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789061698.067661:0:14273:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789061698.067681:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596c600/0x427fa11dc4a9b745 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b74c expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061698.067690:0:14273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7596c600/0x427fa11dc4a9b745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b74c expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061698.067700:0:14273:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97194517e000 10000000:01000000:0.0:1789061698.067705:0:14273:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789061698.067708:0:14273:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97194517e000 10000000:01000000:0.0:1789061698.067711:0:14273:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789061698.067714:0:14273:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97194517e000 from 1 10000000:01000000:0.0:1789061698.067717:0:14273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789061698.067738:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9b753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061698.067745:0:14273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9b753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061698.067753:0:14273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9b753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061698.067765:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779548032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789061698.067804:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061698.067843:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cbf7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061698.067915:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779548032 00000100:00100000:2.0:1789061698.067920:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779548032 00000100:00100000:2.0:1789061698.067952:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789061698.067965:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+6:14273:x1875966779548032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789061698.067974:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061698.067984:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63e000/0x427fa11dc4a9b75a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b753 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.067999:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63e000/0x427fa11dc4a9b75a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b753 expref: 7 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.068008:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63e000/0x427fa11dc4a9b75a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b753 expref: 7 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.068014:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e000, rc 0) 00000100:00100000:2.0:1789061698.068041:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+7:14273:x1875966779548032:12345-0@lo:101:mount.lustre.0 Request processed in 77us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061698.068048:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789061698.068128:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779548032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789061698.068139:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9b753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b75a expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061698.068146:0:14273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9b753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b75a expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061698.068156:0:14273:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789061698.068160:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9b753 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b75a expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061698.068171:0:14273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7596d000/0x427fa11dc4a9b753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b75a expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061698.068177:0:14273:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789061698.068180:0:14273:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789061698.068185:0:14273:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97194517e000 10000000:01000000:0.0:1789061698.068187:0:14273:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789061698.068190:0:14273:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789061698.068192:0:14273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789061698.068204:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596d400/0x427fa11dc4a9b761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061698.068211:0:14273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7596d400/0x427fa11dc4a9b761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061698.068218:0:14273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7596d400/0x427fa11dc4a9b761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061698.068235:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779548160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789061698.068260:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061698.068395:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cbf7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061698.068646:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779548160 00000100:00100000:2.0:1789061698.068651:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779548160 00000100:00100000:0.0:1789061698.068745:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789061698.068752:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+7:14273:x1875966779548160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789061698.068760:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061698.068770:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596c800/0x427fa11dc4a9b768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b761 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061698.068785:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596c800/0x427fa11dc4a9b768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b761 expref: 8 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061698.068793:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596c800/0x427fa11dc4a9b768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b761 expref: 8 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061698.068800:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c800, rc 0) 00000100:00100000:0.0:1789061698.068841:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+8:14273:x1875966779548160:12345-0@lo:101:mount.lustre.0 Request processed in 90us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061698.068848:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789061698.068910:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779548160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789061698.068921:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7596d400/0x427fa11dc4a9b761 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b768 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.068929:0:14273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7596d400/0x427fa11dc4a9b761 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b768 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061698.068970:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779548288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789061698.068990:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061698.069012:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a75b07900 going to sleep for 11 seconds 00000100:00100000:3.0:1789061698.069054:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779548288 00000100:00100000:3.0:1789061698.069058:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779548288 00000100:00100000:3.0:1789061698.069108:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789061698.069114:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+8:14273:x1875966779548288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789061698.069613:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+9:14273:x1875966779548288:12345-0@lo:501:mount.lustre.0 Request processed in 497us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061698.069620:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789061698.069747:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779548288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789061698.069788:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779548416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789061698.069827:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061698.069907:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a75b07900 going to sleep for 11 seconds 00000100:00100000:0.0:1789061698.069912:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779548416 00000100:00100000:0.0:1789061698.069917:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779548416 00000100:00100000:0.0:1789061698.069948:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061698.069956:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+9:14273:x1875966779548416:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789061698.070285:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+9:14273:x1875966779548416:12345-0@lo:503:mount.lustre.0 Request processed in 329us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061698.070292:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789061698.070305:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779548416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789061698.070756:0:14309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d02fbc9-0efc-41a2-bf6f-922e38501192:14309:1875966779548544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061698.070790:0:14309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061698.070883:0:14309:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a75b076c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061698.070915:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779548544 00000100:00100000:3.0:1789061698.070921:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779548544 00000100:00100000:3.0:1789061698.070956:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789061698.070964:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a753ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+9:14309:x1875966779548544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061698.071279:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a753ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+9:14309:x1875966779548544:12345-0@lo:502:llog_process_th.0 Request processed in 315us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061698.071287:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789061698.071454:0:14309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d02fbc9-0efc-41a2-bf6f-922e38501192:14309:1875966779548544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061698.071480:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061698.072252:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061698.072261:0:14309:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789061698.072270:0:14309:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789061698.072274:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789061698.072290:0:14309:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff971a7cbb3380) 00000020:00000080:2.0:1789061698.072309:0:14309:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789061698.072315:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789061698.072384:0:14309:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789061698.072391:0:14309:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9b776 00000020:00000080:2.0:1789061698.072631:0:14309:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789061698.072636:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061698.072639:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061698.072641:0:14309:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789061698.072644:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061698.072648:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061698.072649:0:14309:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789061698.072652:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789061698.072659:0:14309:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff971a7cbb19c0) 00000020:00000080:2.0:1789061698.072669:0:14309:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789061698.072683:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789061698.072686:0:14309:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789061698.072688:0:14309:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789061698.072694:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789061698.072739:0:14309:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97194517e000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789061698.072752:0:14309:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff971a7cbb4d40) 00000020:00000080:2.0:1789061698.072760:0:14309:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789061698.072804:0:14309:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789061698.072812:0:14309:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x427fa11dc4a9b78b 00000020:00000080:2.0:1789061698.072928:0:14309:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789061698.072935:0:14309:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789061698.072939:0:14309:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x427fa11dc4a9b792 00080000:01000000:2.0:1789061698.072944:0:14309:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789061698.072947:0:14309:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9b799 00010000:00010000:0.0:1789061698.153396:0:14309:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789061698.153991:0:14309:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1789061698.154179:0:14309:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789061698.154797:0:14309:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff971945054d40) 00000020:00000080:0.0:1789061698.154817:0:14309:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789061698.154965:0:14309:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789061698.154972:0:14309:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9b7a7 00000020:00000080:1.0:1789061698.155643:0:14309:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789061698.164735:0:14309:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x427fa11dc4a9b7ae 00000020:00000080:1.0:1789061698.166380:0:14309:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789061698.166402:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061698.166409:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061698.166411:0:14309:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789061698.166415:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789061698.166418:0:14309:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1789061698.166420:0:14309:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789061698.166422:0:14309:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789061698.166424:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789061698.166426:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061698.166428:0:14309:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789061698.166431:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061698.166438:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061698.166439:0:14309:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789061698.166445:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789061698.166519:0:14309:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789061698.166535:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061698.166538:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061698.166539:0:14309:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789061698.166542:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789061698.166546:0:14309:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789061698.166561:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061698.166562:0:14309:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789061698.166566:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789061698.166571:0:14309:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:1.0:1789061698.166598:0:14309:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789061698.166601:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789061698.166619:0:14309:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff971a7c7319c0) 00000020:00000080:1.0:1789061698.166635:0:14309:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789061698.166641:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789061698.166711:0:14309:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789061698.166717:0:14309:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789061698.166723:0:14309:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9b7bc 00010000:00080000:1.0:1789061698.166764:0:14309:0:(ldlm_lib.c:102:import_set_conn()) imp ffff971a7618b800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1789061698.167004:0:14309:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789061698.167421:0:14309:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789061698.167467:0:14309:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789061698.168552:0:14309:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789061698.168615:0:14309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789061698.169888:0:14309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789061698.170845:0:14313:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789061698.170852:0:14313:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789061698.172754:0:14309:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789061698.172770:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789061698.172810:0:14309:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789061698.172829:0:14309:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x427fa11dc4a9b7c3 00000100:00080000:2.0:1789061698.172840:0:14309:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789061698.172853:0:14309:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff971a7618b800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789061698.172901:0:14309:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971946cdd500 x1875966779548672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789061698.172929:0:14309:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789061698.172989:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061698.172993:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061698.172995:0:14309:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789061698.172998:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789061698.173001:0:14309:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789061698.173002:0:14309:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789061698.173004:0:14309:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789061698.173006:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789061698.173008:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:3.0:1789061698.174385:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779548672:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789061698.174447:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875966779548672 offset 0 length 520: 4 00000020:00000080:2.0:1789061698.174789:0:14309:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789061698.174802:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789061698.174809:0:14309:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789061698.174815:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061698.174816:0:14309:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789061698.174820:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789061698.174825:0:14309:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:2.0:1789061698.174852:0:14309:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789061698.174855:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789061698.174882:0:14309:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff971a7cbb0000) 00000020:00000080:2.0:1789061698.174901:0:14309:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789061698.174907:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789061698.174981:0:14309:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789061698.174988:0:14309:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789061698.174995:0:14309:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x427fa11dc4a9b7d1 00010000:00080000:2.0:1789061698.175026:0:14309:0:(ldlm_lib.c:102:import_set_conn()) imp ffff971946bc9800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1789061698.176965:0:14309:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789061698.178324:0:14309:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789061698.178351:0:14309:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789061698.181687:0:14309:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789061698.181783:0:14309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789061698.182353:0:14309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789061698.183605:0:14315:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789061698.183613:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789061698.186094:0:14309:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789061698.186109:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789061698.192211:0:14309:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789061698.192246:0:14309:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x427fa11dc4a9b7d8 00000100:00080000:0.0:1789061698.192261:0:14309:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789061698.192274:0:14309:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff971946bc9800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789061698.192318:0:14309:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971947e4b480 x1875966779548800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789061698.192351:0:14309:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789061698.192466:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779548800:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789061698.192563:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875966779548800 offset 0 length 520: 4 00000020:01000000:0.0:1789061698.192784:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061698.192791:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061698.192793:0:14309:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789061698.192796:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061698.192800:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061698.192801:0:14309:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789061698.192804:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789061698.192806:0:14309:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789061698.192808:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061698.192810:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061698.192811:0:14309:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789061698.192813:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061698.192815:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061698.192825:0:14309:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789061698.192829:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789061698.192874:0:14309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e49f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d02fbc9-0efc-41a2-bf6f-922e38501192:14309:1875966779548928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061698.192929:0:14309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061698.192952:0:14309:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4145e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789061698.193034:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779548928 00000100:00100000:1.0:1789061698.193042:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779548928 00000100:00100000:1.0:1789061698.193095:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789061698.193104:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a753ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+9:14309:x1875966779548928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061698.193357:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a753ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+9:14309:x1875966779548928:12345-0@lo:502:llog_process_th.0 Request processed in 254us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061698.193366:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789061698.193687:0:14309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e49f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d02fbc9-0efc-41a2-bf6f-922e38501192:14309:1875966779548928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789061698.193718:0:14309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061698.193723:0:14309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061698.193725:0:14309:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789061698.193729:0:14309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789061698.193931:0:14273:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789061698.193955:0:14273:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789061698.193971:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596d400/0x427fa11dc4a9b761 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b768 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.193985:0:14273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7596d400/0x427fa11dc4a9b761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b768 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061698.193994:0:14273:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97194517e000 from 1 10000000:01000000:1.0:1789061698.193998:0:14273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789061698.194029:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.194038:0:14273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.194061:0:14273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061698.194078:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779549056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789061698.194113:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061698.194139:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1789061698.194158:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779549056 00000100:00100000:1.0:1789061698.194163:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779549056 00000100:00100000:1.0:1789061698.194188:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789061698.194195:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a753ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+9:14273:x1875966779549056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789061698.194205:0:14286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061698.194219:0:14286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9b7e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b7df expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.194240:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9b7e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b7df expref: 10 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.194250:0:14286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9b7e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b7df expref: 10 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.194259:0:14286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524800, rc 0) 00000100:00100000:1.0:1789061698.194289:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a753ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+10:14273:x1875966779549056:12345-0@lo:101:mount.lustre.0 Request processed in 94us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061698.194295:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789061698.194326:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779549056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789061698.194338:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b7e6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.194356:0:14273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b7e6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061698.195119:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779549184:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789061698.195162:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061698.195198:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1789061698.195218:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779549184 00000100:00100000:1.0:1789061698.195222:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779549184 00000100:00100000:1.0:1789061698.195250:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789061698.195257:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a753ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+10:14273:x1875966779549184:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789061698.195270:0:14283:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789061698.195276:0:14283:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789061698.195339:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a753ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+10:14273:x1875966779549184:12345-0@lo:256:mount.lustre.0 Request processed in 83us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061698.195346:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789061698.195383:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779549184:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789061698.198289:0:14273:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789061698.198325:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b7e6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.198338:0:14273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b7e6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061698.198348:0:14273:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97194517e000 from 1 10000000:01000000:1.0:1789061698.198351:0:14273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789061698.198397:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.198417:0:14273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.198429:0:14273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061698.198453:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779549312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789061698.198571:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061698.198612:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1789061698.198939:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779549312 00000100:00100000:2.0:1789061698.198947:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779549312 00000100:00100000:2.0:1789061698.199001:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789061698.199010:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a753efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+10:14273:x1875966779549312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789061698.199024:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061698.199039:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63f400/0x427fa11dc4a9b7f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b7ed expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.199076:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63f400/0x427fa11dc4a9b7f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b7ed expref: 11 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.199088:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63f400/0x427fa11dc4a9b7f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b7ed expref: 11 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.199097:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f400, rc 0) 00000100:00100000:2.0:1789061698.199147:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a753efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+11:14273:x1875966779549312:12345-0@lo:101:mount.lustre.0 Request processed in 139us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061698.199154:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789061698.199245:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779549312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789061698.199267:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b7f4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061698.199278:0:14273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b7f4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061698.199336:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779549440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789061698.199364:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061698.199388:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061698.199440:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779549440 00000100:00100000:0.0:1789061698.199445:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779549440 00000100:00100000:0.0:1789061698.199475:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789061698.199482:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a753ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+11:14273:x1875966779549440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789061698.199913:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a753ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+11:14273:x1875966779549440:12345-0@lo:501:mount.lustre.0 Request processed in 431us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061698.199921:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789061698.200115:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779549440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789061698.200146:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779549568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789061698.200183:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061698.200210:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd04000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061698.200265:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779549568 00000100:00100000:0.0:1789061698.200271:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779549568 00000100:00100000:0.0:1789061698.200293:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789061698.200298:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+11:14273:x1875966779549568:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789061698.200535:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+11:14273:x1875966779549568:12345-0@lo:503:mount.lustre.0 Request processed in 236us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061698.200542:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789061698.201905:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779549568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789061698.202591:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d02fbc9-0efc-41a2-bf6f-922e38501192:14317:1875966779549696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061698.202659:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061698.202694:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061698.202750:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779549696 00000100:00100000:0.0:1789061698.202758:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779549696 00000100:00100000:0.0:1789061698.202805:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789061698.202814:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+11:14317:x1875966779549696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061698.203096:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+11:14317:x1875966779549696:12345-0@lo:502:llog_process_th.0 Request processed in 282us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061698.203106:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789061698.203336:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d02fbc9-0efc-41a2-bf6f-922e38501192:14317:1875966779549696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789061698.203358:0:14317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061698.203368:0:14317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061698.203370:0:14317:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789061698.203377:0:14317:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97194517e000 00000020:00000080:3.0:1789061698.203380:0:14317:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789061698.203387:0:14317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061698.203389:0:14317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061698.203391:0:14317:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789061698.203399:0:14317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061698.203401:0:14317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061698.203402:0:14317:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789061698.203406:0:14317:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97194517e000 00000020:00000080:3.0:1789061698.203408:0:14317:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789061698.203462:0:14317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061698.203464:0:14317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061698.203466:0:14317:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789061698.203468:0:14317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061698.203470:0:14317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061698.203471:0:14317:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789061698.203474:0:14317:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97194517e000 00000020:00000080:3.0:1789061698.203476:0:14317:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789061698.203547:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d02fbc9-0efc-41a2-bf6f-922e38501192:14317:1875966779549824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061698.203580:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061698.203606:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd043c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061698.206572:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779549824 00000100:00100000:1.0:1789061698.206586:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779549824 00000100:00100000:1.0:1789061698.206634:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789061698.206644:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+11:14317:x1875966779549824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061698.206926:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+11:14317:x1875966779549824:12345-0@lo:502:llog_process_th.0 Request processed in 282us (3344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061698.206935:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789061698.207390:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d02fbc9-0efc-41a2-bf6f-922e38501192:14317:1875966779549824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789061698.207424:0:14317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061698.207432:0:14317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061698.207434:0:14317:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789061698.207441:0:14317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789061698.210190:0:14273:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789061698.210231:0:14273:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789061698.210251:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b7f4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.210265:0:14273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b7f4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061698.210311:0:14273:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789061698.210314:0:14273:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97194517e000 10000000:01000000:1.0:1789061698.210317:0:14273:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97194517e000 10000000:01000000:1.0:1789061698.210327:0:14273:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789061698.210334:0:14273:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97194517e000 from 1 10000000:01000000:1.0:1789061698.210336:0:14273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789061698.210377:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c524a00/0x427fa11dc4a9b7fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.210385:0:14273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7c524a00/0x427fa11dc4a9b7fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.210395:0:14273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7c524a00/0x427fa11dc4a9b7fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061698.210422:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779549952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789061698.210519:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061698.210562:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061698.212404:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779549952 00000100:00100000:2.0:1789061698.212420:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779549952 00000100:00100000:2.0:1789061698.212514:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789061698.212526:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+11:14273:x1875966779549952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789061698.212545:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061698.212567:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63f600/0x427fa11dc4a9b802 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b7fb expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.212596:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63f600/0x427fa11dc4a9b802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b7fb expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.212607:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63f600/0x427fa11dc4a9b802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b7fb expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.212615:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f600, rc 0) 00000100:00100000:2.0:1789061698.212692:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14273:x1875966779549952:12345-0@lo:101:mount.lustre.0 Request processed in 167us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061698.212698:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789061698.213345:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779549952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789061698.213365:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7c524a00/0x427fa11dc4a9b7fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b802 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.213375:0:14273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7c524a00/0x427fa11dc4a9b7fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b802 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061698.213443:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779550080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789061698.213479:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061698.213555:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061698.214579:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779550080 00000100:00100000:2.0:1789061698.214590:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779550080 00000100:00100000:2.0:1789061698.214639:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789061698.214647:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14273:x1875966779550080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789061698.214978:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14273:x1875966779550080:12345-0@lo:501:mount.lustre.0 Request processed in 330us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061698.214986:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789061698.216445:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779550080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789061698.216572:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779550208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789061698.216651:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061698.216693:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061698.216717:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779550208 00000100:00100000:1.0:1789061698.216723:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779550208 00000100:00100000:1.0:1789061698.216765:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789061698.216773:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14273:x1875966779550208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789061698.216980:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14273:x1875966779550208:12345-0@lo:503:mount.lustre.0 Request processed in 206us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061698.216988:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789061698.217033:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779550208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789061698.221006:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cde300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d02fbc9-0efc-41a2-bf6f-922e38501192:14320:1875966779550336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061698.221084:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061698.221122:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779550336 00000100:00100000:2.0:1789061698.221128:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779550336 00000100:00100000:2.0:1789061698.221176:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789061698.221185:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14320:x1875966779550336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061698.221450:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14320:x1875966779550336:12345-0@lo:502:llog_process_th.0 Request processed in 265us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061698.221459:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789061698.221537:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bd300 going to sleep for 11 seconds 00000100:00100000:2.0:1789061698.221558:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cde300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d02fbc9-0efc-41a2-bf6f-922e38501192:14320:1875966779550336:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789061698.221616:0:14320:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789061698.221636:0:14320:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff971a80118000) 00000020:00000080:2.0:1789061698.221656:0:14320:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789061698.221726:0:14320:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97194517e000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789061698.221730:0:14320:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97194517e000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789061698.221732:0:14320:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97194517e000 4 00010000:00080000:2.0:1789061698.221761:0:14320:0:(ldlm_lib.c:102:import_set_conn()) imp ffff971a4e080800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1789061698.231736:0:14320:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789061698.237588:0:14320:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789061698.237640:0:14320:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789061698.237657:0:14320:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x427fa11dc4a9b810 00000100:00080000:2.0:1789061698.237669:0:14320:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789061698.237681:0:14320:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff971a4e080800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789061698.237718:0:14320:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971946cde300 x1875966779550464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789061698.237762:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875966779550464:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789061698.237827:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789061698.240236:0:14320:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789061698.240635:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779550464 00000100:00100000:1.0:1789061698.240647:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779550464 00000100:00100000:1.0:1789061698.240697:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061698.240706:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875966779550464:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789061698.240790:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875966779550464:12345-0@lo:38:llog_process_th.0 Request processed in 83us (2961us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789061698.240797:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789061698.244741:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789061698.244758:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971a4e080800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789061698.244765:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789061698.244769:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875966779550464:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789061698.245670:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d02fbc9-0efc-41a2-bf6f-922e38501192:14320:1875966779550592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061698.245753:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061698.245794:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a411cacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061698.245892:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779550592 00000100:00100000:3.0:1789061698.245901:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779550592 00000100:00100000:3.0:1789061698.245943:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789061698.245953:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14320:x1875966779550592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061698.246196:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14320:x1875966779550592:12345-0@lo:502:llog_process_th.0 Request processed in 244us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061698.246204:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789061698.246296:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d02fbc9-0efc-41a2-bf6f-922e38501192:14320:1875966779550592:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789061698.246322:0:14320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789061698.247386:0:14273:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789061698.247416:0:14273:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789061698.247432:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c524a00/0x427fa11dc4a9b7fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b802 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.247443:0:14273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7c524a00/0x427fa11dc4a9b7fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b802 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789061698.247679:0:14273:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789061698.247682:0:14273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789061698.247683:0:14273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061698.247684:0:14273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789061698.247686:0:14273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061698.247692:0:14273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061698.247694:0:14273:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789061698.247695:0:14273:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789061698.247697:0:14273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061698.247698:0:14273:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789061698.247702:0:14273:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789061698.247705:0:14273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789061698.247706:0:14273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789061698.247707:0:14273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061698.247708:0:14273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789061698.247709:0:14273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061698.247710:0:14273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061698.247710:0:14273:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789061698.247711:0:14273:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789061698.247712:0:14273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061698.247713:0:14273:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789061698.247747:0:14273:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789061698.247762:0:14273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779550720:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789061698.247823:0:14273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061698.247854:0:14273:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6d4780 going to sleep for 11 seconds 00000100:00100000:2.0:1789061698.248395:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779550720 00000100:00100000:2.0:1789061698.248405:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779550720 00000100:00100000:2.0:1789061698.248455:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789061698.248465:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14273:x1875966779550720:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789061698.248514:0:14286:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789061698.248529:0:14286:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789061698.318324:0:14286:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789061698.318375:0:14286:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789061698.318461:0:14307:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789061698.318466:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789061698.318787:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.318810:0:14307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9b7e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b7df expref: 12 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.318819:0:14307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.318953:0:14307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9b7e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9b7df expref: 12 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061698.318969:0:14307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9b7e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9b7df expref: 12 pid: 14286 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061698.318997:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14307:1875966779550848:0@lo:104: 00000100:00100000:1.0:1789061698.319158:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061698.319307:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d6e1240 going to sleep for 11 seconds 00000100:00100000:2.0:1789061698.319456:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779550848 00000100:00100000:2.0:1789061698.319465:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779550848 00000100:00100000:2.0:1789061698.319784:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789061698.319796:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d02fbc9-0efc-41a2-bf6f-922e38501192+3:14307:x1875966779550848:12345-0@lo:104: 00010000:00010000:2.0:1789061698.319810:0:14274:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b7e6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.319969:0:14274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789061698.319975:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d02fbc9-0efc-41a2-bf6f-922e38501192+3:14307:x1875966779550848:12345-0@lo:104: Request processed in 183us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061698.319982:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061698.320063:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14307:1875966779550848:0@lo:104: 00010000:00010000:1.0:1789061698.320081:0:14307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.325735:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061698.325748:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b7e6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.325761:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1789061698.325766:0:14280:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9b7e6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.325778:0:14280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9b7e6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061698.325786:0:14280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9b7e6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061698.325792:0:14280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061698.325836:0:14280:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b7e6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.325927:0:14280:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061698.325954:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b7e6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.325962:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a7c525400/0x427fa11dc4a9b7df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b7e6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.325996:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061698.325998:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061698.326000:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061698.326101:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d02fbc9-0efc-41a2-bf6f-922e38501192:3313:1875966779550976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061698.326235:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061698.326331:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779550976 00000100:00100000:2.0:1789061698.326340:0:14276:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779550976 00010000:00010000:2.0:1789061698.326366:0:14276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9b7e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b7df expref: 13 pid: 14286 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061698.326392:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789061698.326400:0:14276:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d02fbc9-0efc-41a2-bf6f-922e38501192+13:3313:x1875966779550976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789061698.326412:0:14276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061698.326417:0:14276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9b7e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b7df expref: 13 pid: 14286 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.326429:0:14276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9b7e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9b7df expref: 13 pid: 14286 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.326442:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7c524800/0x427fa11dc4a9b7e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9b7df expref: 13 pid: 14286 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.326455:0:14276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.326464:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789061698.326477:0:14276:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008011720s 00010000:00010000:2.0:1789061698.327142:0:14276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.327152:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.327159:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.327166:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.327171:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061698.327185:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.327193:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.327209:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061698.327221:0:14276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061698.327266:0:14276:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:3313:x1875966779550976:12345-0@lo:103:ldlm_bl.0 Request processed in 866us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061698.327275:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789061698.328739:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+11:14273:x1875966779550720:12345-0@lo:253:mount.lustre.0 Request processed in 80269us (80909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061698.328764:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789061698.328937:0:14273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14273:1875966779550720:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789061698.328952:0:14273:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789061698.328955:0:14273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789061698.328957:0:14273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789061698.328959:0:14273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061698.328961:0:14273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789061698.328962:0:14273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061698.328963:0:14273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061698.328965:0:14273:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789061698.328966:0:14273:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789061698.328968:0:14273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061698.328969:0:14273:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789061698.328981:0:14273:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789061698.329648:0:14307:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061698.329661:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061698.329668:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9b817 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061698.335098:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d02fbc9-0efc-41a2-bf6f-922e38501192:3313:1875966779550976:0@lo:103:ldlm_bl.0 00080000:10000000:1.0:1789061698.336828:0:14273:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789061698.337281:0:14273:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789061698.337824:0:14273:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789061698.338157:0:14273:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789061698.339013:0:14273:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789061698.339336:0:14273:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789061698.340935:0:14273:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789061698.341241:0:14273:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789061698.341711:0:14273:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789061698.342091:0:14273:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789061698.342448:0:14273:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789061698.343700:0:14273:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789061698.379276:0:14273:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789061698.380119:0:14273:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789061698.380257:0:14329:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789061698.380261:0:14329:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789061698.380619:0:14330:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1789061698.380701:0:14330:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061698.384128:0:14330:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789061698.384468:0:14330:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789061698.384473:0:14330:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1789061698.387406:0:14273:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789061698.387680:0:14273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789061698.388300:0:14273:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789061698.388311:0:14273:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789061698.388836:0:14273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061698.394158:0:14273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789061698.395366:0:14273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789061698.395431:0:14273:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1789061698.398384:0:14273:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1789061698.406979:0:14273:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789061698.470468:0:14273:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789061698.470589:0:14273:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7c9c18cf988 00100000:10000000:3.0:1789061698.470597:0:14273:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789061698.479943:0:14273:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789061698.479964:0:14273:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789061698.479986:0:14273:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789061698.480012:0:14273:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789061698.950964:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789061699.070325:0:14288:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789061699.070334:0:14288:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97194517e000 from 6 10000000:01000000:0.0:1789061699.070340:0:14288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789061699.070420:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061699.070432:0:14288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061699.070473:0:14288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061699.070536:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779551104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789061699.071806:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061699.071956:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cfac6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061699.079858:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779551104 00000100:00100000:2.0:1789061699.079872:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779551104 00000100:00100000:2.0:1789061699.080049:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789061699.080060:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+11:14288:x1875966779551104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061699.080077:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061699.080159:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9b825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b81e expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061699.080313:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9b825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b81e expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061699.080326:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9b825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b81e expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061699.080404:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63ec00, rc 0) 00000100:00100000:2.0:1789061699.080477:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14288:x1875966779551104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 420us (8675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061699.080484:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789061699.080566:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779551104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061699.080584:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b825 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061699.080594:0:14288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b825 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061699.080662:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779551232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789061699.080696:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061699.080725:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a460f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789061699.080739:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779551232 00000100:00100000:2.0:1789061699.080744:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779551232 00000100:00100000:2.0:1789061699.080767:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789061699.080774:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14288:x1875966779551232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789061699.080786:0:14286:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789061699.080803:0:14286:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789061699.080807:0:14286:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789061699.080887:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14288:x1875966779551232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061699.080894:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789061699.081057:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779551232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789061699.081483:0:14288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789061699.081512:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b825 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061699.081522:0:14288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b825 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789061699.264253:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789061699.965781:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789061700.288860:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789061700.991085:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061702.019248:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061703.037654:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789061703.422944:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789061703.422951:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789061703.422955:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789061703.422957:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789061703.422961:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789061703.422964:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789061703.422967:0:8:0:(import.c:65:import_set_state_nolock()) ffff971a4e080800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789061703.422985:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff971a4e080800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789061703.423009:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971947e4aa00 x1875966779551488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789061703.423057:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061703.423070:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d02fbc9-0efc-41a2-bf6f-922e38501192:3311:1875966779551360:0@lo:400:kworker.0 00000100:00100000:0.0:1789061703.423195:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061703.423253:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779551360 00000100:00100000:0.0:1789061703.423260:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779551360 00000100:00100000:1.0:1789061703.424442:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875966779551488:0@lo:38:kworker.0 00000100:00100000:1.0:1789061703.424522:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061703.425885:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789061703.425902:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:3311:x1875966779551360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061703.426464:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:3311:x1875966779551360:12345-0@lo:400:kworker.0 Request processed in 566us (3268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061703.426473:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789061703.426544:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779551488 00000100:00100000:0.0:1789061703.426551:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779551488 00000100:00100000:0.0:1789061703.426574:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789061703.426579:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875966779551488:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789061703.426600:0:14293:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:0.0:1789061703.426634:0:14293:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x427fa11dc4a9b82c 00000004:00100000:0.0:1789061703.426649:0:14293:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789061703.430095:0:14293:0:(import.c:65:import_set_state_nolock()) ffff971a4e5b6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789061703.430202:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875966779551488:12345-0@lo:38:kworker.0 Request processed in 3617us (5675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061703.430214:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789061703.431089:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d02fbc9-0efc-41a2-bf6f-922e38501192:3311:1875966779551360:0@lo:400:kworker.0 00010000:00080000:0.0:1789061703.431161:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff971947e4aa00 x1875966779551488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789061713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789061703.431177:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789061703.431186:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789061703.431192:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789061703.431194:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971a4e080800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789061703.431201:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875966779551488:0@lo:38:kworker.0 00000001:02000400:1.0:1789061703.517858:0:14573:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789061704.062243:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061705.086652:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061706.109731:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789061706.822347:0:14724:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd2d48260 20000000:00000080:2.0:1789061706.822375:0:14724:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff971a7c820000 uarg=0000000000000000 20000000:01000000:2.0:1789061706.822412:0:14724:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789061706.822420:0:14724:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789061706.822425:0:14724:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789061706.823404:0:14725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789061706.835617:0:14724:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789061706.852507:0:14724:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789061706.852752:0:14724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061706.852772:0:14724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a4f63f400/0x427fa11dc4a9b7f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b7ed expref: 11 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061706.852780:0:14724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061706.852824:0:14724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a4f63f400/0x427fa11dc4a9b7f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9b7ed expref: 11 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061706.852848:0:14724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a4f63f400/0x427fa11dc4a9b7f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9b7ed expref: 11 pid: 14283 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061706.852864:0:14724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14724:1875966779551616:0@lo:104: 00000100:00100000:2.0:1789061706.852930:0:14724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061706.852981:0:14724:0:(client.c:2716:ptlrpc_set_wait()) set ffff971946ab2900 going to sleep for 11 seconds 00000100:00100000:1.0:1789061706.854226:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779551616 00000100:00100000:1.0:1789061706.854239:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779551616 00000100:00100000:1.0:1789061706.854297:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789061706.854308:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d02fbc9-0efc-41a2-bf6f-922e38501192+3:14724:x1875966779551616:12345-0@lo:104: 00010000:00010000:1.0:1789061706.854324:0:14274:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b7f4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061706.854416:0:14274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789061706.854423:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d02fbc9-0efc-41a2-bf6f-922e38501192+3:14724:x1875966779551616:12345-0@lo:104: Request processed in 118us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061706.854431:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789061706.855094:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061706.855104:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b7f4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855127:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525200 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061706.855133:0:14279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9b7f4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855142:0:14279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9b7f4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061706.855149:0:14279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9b7f4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061706.855154:0:14279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789061706.855220:0:14279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b7f4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855228:0:14279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061706.855255:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b7f4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855262:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a7c525200/0x427fa11dc4a9b7ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b7f4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855277:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061706.855279:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061706.855281:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061706.855289:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061706.855304:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779551744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789061706.855356:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061706.855420:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779551744 00000100:00100000:0.0:1789061706.855426:0:14276:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779551744 00010000:00010000:0.0:1789061706.855455:0:14276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a4f63f400/0x427fa11dc4a9b7f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b7ed expref: 12 pid: 14283 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061706.855481:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789061706.855520:0:14276:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:3310:x1875966779551744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789061706.855532:0:14276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061706.855537:0:14276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a4f63f400/0x427fa11dc4a9b7f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b7ed expref: 12 pid: 14283 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855548:0:14276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a4f63f400/0x427fa11dc4a9b7f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9b7ed expref: 12 pid: 14283 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855565:0:14276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855574:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855592:0:14276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855599:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855605:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855611:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855617:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fa00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061706.855620:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855634:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061706.855645:0:14724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63f400/0x427fa11dc4a9b7f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9b7ed expref: 12 pid: 14283 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855645:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061706.855664:0:14276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061706.855716:0:14276:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:3310:x1875966779551744:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061706.855722:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061706.855826:0:14724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14724:1875966779551616:0@lo:104: 00010000:00010000:3.0:1789061706.855849:0:14724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061706.855869:0:14724:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061706.855876:0:14724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061706.855881:0:14724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63fa00/0x427fa11dc4a9b833 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061706.855905:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779551744:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789061707.133655:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789061708.031479:0:14288:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789061708.031511:0:14288:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97194517e000 from 10 10000000:01000000:3.0:1789061708.031517:0:14288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789061708.031563:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061708.031576:0:14288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061708.031589:0:14288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061708.031615:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779551872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789061708.031684:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061708.031739:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4ea02000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061708.031826:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779551872 00000100:00100000:0.0:1789061708.031834:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779551872 00000100:00100000:0.0:1789061708.031887:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789061708.031895:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+11:14288:x1875966779551872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061708.031909:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061708.031923:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9b841 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b83a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061708.031944:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9b841 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b83a expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061708.031955:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9b841 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b83a expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061708.031965:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596da00, rc 0) 00000100:00100000:0.0:1789061708.032021:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14288:x1875966779551872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061708.032035:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789061708.032460:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779551872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061708.032476:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b841 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061708.032516:0:14288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b841 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061708.032588:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779552000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061708.032620:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061708.032645:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4ea02000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061708.032872:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779552000 00000100:00100000:0.0:1789061708.032877:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779552000 00000100:00100000:0.0:1789061708.032909:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789061708.032916:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14288:x1875966779552000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061708.033176:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14288:x1875966779552000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061708.033183:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789061708.033344:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779552000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061708.033376:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779552128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061708.033414:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061708.033437:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4ea02000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061708.033481:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779552128 00000100:00100000:0.0:1789061708.033510:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779552128 00000100:00100000:0.0:1789061708.033538:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789061708.033544:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14288:x1875966779552128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061708.033696:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14288:x1875966779552128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061708.033704:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789061708.033787:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779552128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789061708.036325:0:14776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789061708.039070:0:14288:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789061708.039103:0:14288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061708.039118:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b841 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061708.039132:0:14288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b841 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061708.162719:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789061708.541916:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789061708.541928:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789061708.541931:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789061708.541934:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789061708.542025:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779552256:0@lo:400:kworker.0 00000100:00100000:2.0:1789061708.542102:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061708.542503:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789061698/real 1789061698] req@ffff971947e4b480 x1875966779548800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789061708 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061708.542526:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff971947e4b480 x1875966779548800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789061708 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061708.542535:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789061698/real 1789061698] req@ffff971946cdd500 x1875966779548672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789061708 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061708.542545:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff971946cdd500 x1875966779548672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789061708 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789061708.542561:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971946bc9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789061708.542590:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789061708.542594:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779548800:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789061708.542601:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971a7618b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789061708.542605:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789061708.542608:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779548672:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789061708.542648:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779552256 00000100:00100000:0.0:1789061708.542657:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779552256 00000100:00080000:3.0:1789061708.542687:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789061708.542691:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789061708.542693:0:8:0:(import.c:65:import_set_state_nolock()) ffff971a7618b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789061708.542698:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00100000:0.0:1789061708.542709:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789061708.542711:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1789061708.542717:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779552256:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789061708.542720:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff971a7618b800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789061708.542742:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971946bd0e00 x1875966779552384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789061708.542757:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789061708.542760:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789061708.542762:0:8:0:(import.c:65:import_set_state_nolock()) ffff971946bc9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789061708.542765:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:3.0:1789061708.542768:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789061708.542771:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff971946bc9800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789061708.542791:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971946bd0a80 x1875966779552512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789061708.542810:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779552384:0@lo:8:kworker.0 00000400:00000100:3.0:1789061708.542837:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875966779552384 offset 0 length 520: 4 00000100:00100000:3.0:1789061708.542858:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779552512:0@lo:8:kworker.0 00000400:00000100:3.0:1789061708.542873:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875966779552512 offset 0 length 520: 4 00000100:00100000:0.0:1789061708.554559:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779552256:12345-0@lo:400:kworker.0 Request processed in 11832us (12446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061708.554574:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789061708.559534:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9719453e4e00 x1875966779552256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061708.559556:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779552256:0@lo:400:kworker.0 00010000:00010000:2.0:1789061709.191474:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061710.218707:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789061710.526165:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789061711.243649:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061712.254660:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789061713.002071:0:14973:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789061713.002075:0:14973:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789061713.002390:0:14973:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff971a56f4c000 00000020:01000004:3.0:1789061713.002407:0:14973:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789061713.002421:0:14973:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789061713.002434:0:14973:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff971a760a99c0) 00000020:00000080:3.0:1789061713.002450:0:14973:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789061713.034733:0:14973:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789061713.035072:0:14973:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789061713.036150:0:14973:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789061713.036419:0:14973:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789061713.036704:0:14973:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789061713.037138:0:14973:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:1.0:1789061713.037286:0:14973:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:1.0:1789061713.037389:0:14973:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:1.0:1789061713.037983:0:14973:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 636: rc = 0 00100000:10000000:1.0:1789061713.038225:0:14973:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 636: rc = 0 00100000:10000000:1.0:1789061713.038529:0:14973:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 636: rc = 0 00100000:10000000:1.0:1789061713.038816:0:14973:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 636: rc = 0 00100000:10000000:1.0:1789061713.039068:0:14973:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 636: rc = 0 00100000:10000000:1.0:1789061713.039413:0:14973:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 636: rc = 0 00000020:00000080:1.0:1789061713.041390:0:14973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789061713.041408:0:14973:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789061713.041425:0:14973:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x427fa11dc4a9b84f 00000020:01000004:1.0:1789061713.041438:0:14973:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789061713.041471:0:14973:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789061713.041476:0:14973:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789061713.041484:0:14973:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789061713.041543:0:14973:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789061713.041574:0:14973:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff971a4f0799c0) 00000020:00000080:1.0:1789061713.041604:0:14973:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1789061713.045823:0:14973:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789061713.046095:0:14973:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789061713.046102:0:14973:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789061713.058956:0:14973:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789061713.058974:0:14973:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789061713.060681:0:14973:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789061713.060693:0:14973:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789061713.081863:0:14973:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061713.082462:0:14973:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789061713.082470:0:14973:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789061713.083071:0:14973:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789061713.083079:0:14973:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789061713.104907:0:14973:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061713.105168:0:14973:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789061713.105175:0:14973:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789061713.108274:0:14973:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789061713.108289:0:14973:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789061713.109135:0:14973:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789061713.109144:0:14973:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789061713.111639:0:14973:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061713.111837:0:14973:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789061713.111844:0:14973:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789061713.113008:0:14973:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789061713.113020:0:14973:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789061713.156966:0:14973:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789061713.157182:0:14973:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789061713.157189:0:14973:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789061713.158694:0:14973:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789061713.158704:0:14973:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789061713.159225:0:14973:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789061713.159249:0:14973:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789061713.159256:0:14973:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789061713.169695:0:14973:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789061713.169743:0:14973:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789061713.169748:0:14973:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789061713.169750:0:14973:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789061713.169752:0:14973:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061713.169753:0:14973:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061713.169754:0:14973:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061713.169756:0:14973:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061713.169757:0:14973:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061713.169758:0:14973:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061713.169760:0:14973:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789061713.169764:0:14973:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789061713.169766:0:14973:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789061713.169767:0:14973:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789061713.169768:0:14973:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061713.169769:0:14973:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061713.169770:0:14973:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061713.169771:0:14973:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061713.169772:0:14973:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061713.169773:0:14973:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061713.169774:0:14973:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789061713.169805:0:14973:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789061713.169826:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779552640:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789061713.170084:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061713.170140:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061713.170222:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779552640 00000100:00100000:3.0:1789061713.170232:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779552640 00000100:00100000:3.0:1789061713.170287:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789061713.170297:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14973:x1875966779552640:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789061713.170329:0:14283:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789061713.170333:0:14283:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789061713.170337:0:14283:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789061713.189289:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14973:x1875966779552640:12345-0@lo:253:mount.lustre.0 Request processed in 18985us (19197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061713.189304:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789061713.189385:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779552640:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789061713.189412:0:14973:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789061713.189417:0:14973:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789061713.189420:0:14973:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789061713.189421:0:14973:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061713.189444:0:14973:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789061713.189446:0:14973:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061713.189447:0:14973:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061713.189459:0:14973:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789061713.189462:0:14973:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061713.189464:0:14973:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789061713.189541:0:14973:0:(tgt_mount.c:101:server_register_mount()) register mount ffff971a56f4c000 from lustre-OST0000 10000000:01000000:1.0:1789061713.189598:0:14973:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789061713.189602:0:14973:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789061713.189612:0:14973:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff971a7c734d40 local copy 00010000:00010000:1.0:1789061713.189625:0:14973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596c600/0x427fa11dc4a9b745 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b74c expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061713.191456:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779552768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789061713.192702:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061713.193066:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4ea02540 going to sleep for 11 seconds 00000100:00100000:0.0:1789061713.194017:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779552768 00000100:00100000:0.0:1789061713.194034:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779552768 00000100:00100000:0.0:1789061713.194104:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789061713.194114:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14973:x1875966779552768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789061713.194399:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14973:x1875966779552768:12345-0@lo:501:mount.lustre.0 Request processed in 286us (1703us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789061713.194407:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789061713.194539:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779552768:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789061713.194574:0:14973:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789061713.194871:0:14973:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789061713.194883:0:14973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596c600/0x427fa11dc4a9b745 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b74c expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061713.194908:0:14973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7596c600/0x427fa11dc4a9b745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b74c expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061713.194946:0:14973:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff971a56f4c000 10000000:01000000:3.0:1789061713.194952:0:14973:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789061713.194959:0:14973:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff971a7c734d40 10000000:01000000:3.0:1789061713.194961:0:14973:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789061713.194966:0:14973:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff971a7c734d40 from 1 10000000:01000000:3.0:1789061713.194969:0:14973:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789061713.195022:0:14973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9b85d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061713.195032:0:14973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9b85d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061713.195058:0:14973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9b85d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061713.195088:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779552896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789061713.195171:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061713.195214:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4ea02540 going to sleep for 11 seconds 00000100:00100000:0.0:1789061713.196931:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779552896 00000100:00100000:0.0:1789061713.196947:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779552896 00000100:00100000:0.0:1789061713.197062:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789061713.197074:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+12:14973:x1875966779552896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789061713.197094:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061713.197742:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596de00/0x427fa11dc4a9b864 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b85d expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.197796:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596de00/0x427fa11dc4a9b864 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b85d expref: 13 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.197811:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596de00/0x427fa11dc4a9b864 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b85d expref: 13 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.197821:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596de00, rc 0) 00000100:00100000:0.0:1789061713.197927:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+13:14973:x1875966779552896:12345-0@lo:101:mount.lustre.0 Request processed in 856us (2756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061713.197939:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789061713.198591:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779552896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789061713.198626:0:14973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9b85d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b864 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061713.198640:0:14973:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9b85d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b864 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061713.198666:0:14973:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789061713.198694:0:14973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9b85d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b864 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061713.198725:0:14973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a82043400/0x427fa11dc4a9b85d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b864 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061713.198734:0:14973:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789061713.198741:0:14973:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789061713.198748:0:14973:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789061713.198751:0:14973:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789061713.198787:0:14973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4f63ee00/0x427fa11dc4a9b86b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061713.198795:0:14973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4f63ee00/0x427fa11dc4a9b86b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061713.198805:0:14973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4f63ee00/0x427fa11dc4a9b86b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061713.198827:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789061713.198903:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061713.198947:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061713.199024:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779553024 00000100:00100000:0.0:1789061713.199037:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779553024 00000100:00100000:1.0:1789061713.199315:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789061713.199332:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+13:14973:x1875966779553024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789061713.199352:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061713.199373:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c524e00/0x427fa11dc4a9b872 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b86b expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061713.199405:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c524e00/0x427fa11dc4a9b872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b86b expref: 14 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061713.199417:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c524e00/0x427fa11dc4a9b872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b86b expref: 14 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061713.199426:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524e00, rc 0) 00000100:00100000:1.0:1789061713.199528:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+14:14973:x1875966779553024:12345-0@lo:101:mount.lustre.0 Request processed in 202us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061713.199534:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789061713.200771:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789061713.200795:0:14973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4f63ee00/0x427fa11dc4a9b86b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b872 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061713.200806:0:14973:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4f63ee00/0x427fa11dc4a9b86b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b872 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789061713.201644:0:14973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789061713.210725:0:14973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789061713.211040:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789061713.211084:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789061713.211118:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789061713.216540:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789061713.216647:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789061713.216682:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789061713.216767:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789061713.216776:0:14973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789061713.216908:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789061713.216977:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061713.217034:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061713.217224:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779553152 00000100:00100000:3.0:1789061713.217232:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779553152 00000100:00100000:3.0:1789061713.217282:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789061713.217291:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+14:14973:x1875966779553152:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789061713.217708:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+14:14973:x1875966779553152:12345-0@lo:501:mount.lustre.0 Request processed in 417us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061713.217724:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789061713.218851:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789061713.218969:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789061713.219034:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061713.219119:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061713.219480:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779553280 00000100:00100000:3.0:1789061713.219513:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779553280 00000100:00100000:3.0:1789061713.219557:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789061713.219565:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+14:14973:x1875966779553280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789061713.220274:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+14:14973:x1875966779553280:12345-0@lo:503:mount.lustre.0 Request processed in 707us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061713.220283:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789061713.220417:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553280:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789061713.221374:0:14973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789061713.221454:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789061713.221691:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061713.221733:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061713.221799:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779553408 00000100:00100000:3.0:1789061713.221805:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779553408 00000100:00100000:3.0:1789061713.221845:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789061713.221853:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+14:14973:x1875966779553408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789061713.222078:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+14:14973:x1875966779553408:12345-0@lo:502:mount.lustre.0 Request processed in 225us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061713.222085:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789061713.222341:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789061713.222683:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789061713.222733:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789061713.222780:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789061713.222828:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789061713.222875:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789061713.222909:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789061713.222967:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789061713.223001:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789061713.223032:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789061713.223091:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789061713.223126:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789061713.223173:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789061713.223205:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789061713.223252:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061713.223274:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061713.223342:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779553536 00000100:00100000:0.0:1789061713.223349:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779553536 00000100:00100000:0.0:1789061713.223386:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789061713.223395:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+14:14973:x1875966779553536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789061713.223595:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+14:14973:x1875966779553536:12345-0@lo:502:mount.lustre.0 Request processed in 201us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061713.223604:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789061713.224377:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789061713.224481:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789061713.224508:0:14973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789061713.227945:0:14987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789061713.227961:0:14987:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789061713.227970:0:14987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061713.227972:0:14987:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789061713.227979:0:14987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789061713.227995:0:14987:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff971a760acd40) 00000020:00000080:3.0:1789061713.228019:0:14987:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789061713.228025:0:14987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789061713.228091:0:14987:0:(tgt_mount.c:153:server_get_mount()) get mount ffff971a56f4c000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789061713.228099:0:14987:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789061713.228106:0:14987:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x427fa11dc4a9b880 00010000:00010000:3.0:1789061713.234216:0:14987:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789061713.236341:0:14987:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789061713.239975:0:14987:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789061713.241210:0:14987:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789061713.241221:0:14987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061713.241227:0:14987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061713.241229:0:14987:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789061713.241240:0:14987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789061713.241242:0:14987:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1789061713.241244:0:14987:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789061713.241245:0:14987:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789061713.241247:0:14987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789061713.241249:0:14987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061713.241251:0:14987:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789061713.241253:0:14987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061713.241256:0:14987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061713.241257:0:14987:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789061713.241260:0:14987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789061713.241262:0:14987:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789061713.241264:0:14987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061713.241266:0:14987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061713.241267:0:14987:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789061713.241269:0:14987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061713.241271:0:14987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061713.241272:0:14987:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789061713.241275:0:14987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789061713.241327:0:14987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061713.241330:0:14987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061713.241332:0:14987:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789061713.241334:0:14987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789061713.244938:0:14973:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789061713.244979:0:14973:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789061713.244999:0:14973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4f63ee00/0x427fa11dc4a9b86b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b872 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061713.245013:0:14973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4f63ee00/0x427fa11dc4a9b86b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b872 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061713.245022:0:14973:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a56f4c000 from 1 10000000:01000000:2.0:1789061713.245024:0:14973:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789061713.245065:0:14973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061713.245073:0:14973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061713.245085:0:14973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061713.245127:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789061713.245198:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061713.245248:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bd240 going to sleep for 11 seconds 00000100:00100000:1.0:1789061713.246331:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779553664 00000100:00100000:1.0:1789061713.246344:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779553664 00000100:00100000:1.0:1789061713.246402:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789061713.246420:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+14:14973:x1875966779553664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789061713.246436:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061713.246451:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9b88e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b887 expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061713.246477:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9b88e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b887 expref: 15 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061713.246507:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9b88e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b887 expref: 15 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061713.246517:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524000, rc 0) 00000100:00100000:1.0:1789061713.246587:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+15:14973:x1875966779553664:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061713.246594:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789061713.246782:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789061713.246798:0:14973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b88e expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061713.246807:0:14973:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b88e expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789061713.247331:0:14973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789061713.247901:0:14973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789061713.248129:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789061713.248182:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789061713.248238:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789061713.248245:0:14973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789061713.248316:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789061713.248376:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061713.248410:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bd240 going to sleep for 11 seconds 00000100:00100000:1.0:1789061713.248595:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779553792 00000100:00100000:1.0:1789061713.248602:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779553792 00000100:00100000:1.0:1789061713.248637:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789061713.248644:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+15:14973:x1875966779553792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789061713.248837:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+15:14973:x1875966779553792:12345-0@lo:501:mount.lustre.0 Request processed in 192us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061713.248845:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789061713.249442:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789061713.249481:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553920:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789061713.251077:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061713.251116:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061713.251250:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779553920 00000100:00100000:3.0:1789061713.251257:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779553920 00000100:00100000:3.0:1789061713.251302:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789061713.251310:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+15:14973:x1875966779553920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789061713.251521:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+15:14973:x1875966779553920:12345-0@lo:503:mount.lustre.0 Request processed in 211us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061713.251530:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789061713.251685:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779553920:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789061713.252314:0:14973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789061713.252391:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554048:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789061713.252436:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061713.252566:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061713.255126:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779554048 00000100:00100000:3.0:1789061713.255138:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779554048 00000100:00100000:3.0:1789061713.255217:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789061713.255228:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+15:14973:x1875966779554048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789061713.255523:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+15:14973:x1875966779554048:12345-0@lo:502:mount.lustre.0 Request processed in 297us (3085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061713.255531:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789061713.255657:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789061713.255976:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789061713.256029:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789061713.256076:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789061713.256112:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789061713.256145:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789061713.256195:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789061713.256232:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789061713.256262:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789061713.256298:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789061713.256356:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061713.257026:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779554176 00000100:00100000:1.0:1789061713.257035:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779554176 00000100:00100000:1.0:1789061713.257071:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789061713.257081:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a453d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+15:14973:x1875966779554176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789061713.257255:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a453d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+15:14973:x1875966779554176:12345-0@lo:502:mount.lustre.0 Request processed in 176us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061713.257272:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789061713.257468:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bd240 going to sleep for 11 seconds 00000100:00100000:2.0:1789061713.257793:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789061713.258022:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789061713.258037:0:14973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789061713.261113:0:14991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061713.261132:0:14991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061713.261134:0:14991:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789061713.261140:0:14991:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff971a56f4c000 00000020:00000080:0.0:1789061713.261143:0:14991:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789061713.261150:0:14991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061713.261152:0:14991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061713.261154:0:14991:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789061713.261156:0:14991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061713.261162:0:14991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061713.261164:0:14991:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789061713.261167:0:14991:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff971a56f4c000 00000020:00000080:0.0:1789061713.261184:0:14991:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789061713.261252:0:14991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061713.261256:0:14991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061713.261257:0:14991:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789061713.261260:0:14991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061713.261262:0:14991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061713.261264:0:14991:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789061713.261267:0:14991:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff971a56f4c000 00000020:00000080:0.0:1789061713.261269:0:14991:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789061713.261307:0:14991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061713.261310:0:14991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061713.261312:0:14991:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789061713.261315:0:14991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789061713.262879:0:14973:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789061713.262921:0:14973:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789061713.262943:0:14973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b88e expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061713.262956:0:14973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b88e expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061713.263011:0:14973:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789061713.263014:0:14973:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff971a56f4c000 10000000:01000000:3.0:1789061713.263017:0:14973:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff971a56f4c000 10000000:01000000:3.0:1789061713.263021:0:14973:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789061713.263027:0:14973:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff971a56f4c000 from 1 10000000:01000000:3.0:1789061713.263036:0:14973:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789061713.263074:0:14973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042c00/0x427fa11dc4a9b895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061713.263084:0:14973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a82042c00/0x427fa11dc4a9b895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061713.263096:0:14973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a82042c00/0x427fa11dc4a9b895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061713.263122:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789061713.263201:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061713.263245:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ceff840 going to sleep for 11 seconds 00000100:00100000:0.0:1789061713.264655:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779554304 00000100:00100000:0.0:1789061713.264666:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779554304 00000100:00100000:0.0:1789061713.264718:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789061713.264726:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a453d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+15:14973:x1875966779554304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789061713.264740:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061713.264764:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596d200/0x427fa11dc4a9b89c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b895 expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.264787:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596d200/0x427fa11dc4a9b89c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b895 expref: 16 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.264798:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596d200/0x427fa11dc4a9b89c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b895 expref: 16 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.264806:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596d200, rc 0) 00000100:00100000:0.0:1789061713.265016:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a453d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14973:x1875966779554304:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061713.265025:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789061713.265144:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789061713.265163:0:14973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a82042c00/0x427fa11dc4a9b895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b89c expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061713.265172:0:14973:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a82042c00/0x427fa11dc4a9b895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b89c expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789061713.270511:0:14973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789061713.272254:0:14973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061713.275229:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789061713.275311:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789061713.275369:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789061713.275421:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789061713.275460:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789061713.275532:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789061713.275570:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789061713.275615:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789061713.275678:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789061713.275713:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789061713.275745:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789061713.277029:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789061713.277068:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789061713.277105:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789061713.278685:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789061713.278808:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789061713.278846:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789061713.278926:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789061713.278993:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789061713.279027:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789061713.279075:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789061713.279109:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789061713.279141:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789061713.279186:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789061713.279219:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789061713.279251:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789061713.279297:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789061713.279334:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789061713.279424:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789061713.279448:0:14973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789061713.279599:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789061713.279670:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061713.279712:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ceff840 going to sleep for 11 seconds 00000100:00100000:2.0:1789061713.281754:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779554432 00000100:00100000:2.0:1789061713.281769:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779554432 00000100:00100000:2.0:1789061713.281828:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789061713.281838:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a453d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14973:x1875966779554432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789061713.282169:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a453d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14973:x1875966779554432:12345-0@lo:501:mount.lustre.0 Request processed in 331us (2497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061713.282178:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1789061713.282943:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061713.283033:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789061713.283092:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789061713.283150:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061713.283196:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ceff840 going to sleep for 11 seconds 00000100:00100000:0.0:1789061713.283926:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779554560 00000100:00100000:0.0:1789061713.283935:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779554560 00000100:00100000:0.0:1789061713.283983:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789061713.283992:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14973:x1875966779554560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789061713.284193:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14973:x1875966779554560:12345-0@lo:503:mount.lustre.0 Request processed in 201us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061713.284201:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789061713.284230:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554560:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789061713.286435:0:14973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789061713.287116:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789061713.287192:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061713.287380:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0480 going to sleep for 11 seconds 00000100:00100000:2.0:1789061713.288283:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779554688 00000100:00100000:2.0:1789061713.288293:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779554688 00000100:00100000:2.0:1789061713.288369:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789061713.288379:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14973:x1875966779554688:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789061713.288663:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14973:x1875966779554688:12345-0@lo:502:mount.lustre.0 Request processed in 285us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061713.288671:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789061713.289368:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789061713.290302:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789061713.290374:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789061713.290410:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789061713.292421:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789061713.292480:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789061713.292574:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789061713.292621:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789061713.292655:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789061713.292701:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789061713.292739:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789061713.292772:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789061713.292834:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789061713.292886:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789061713.292923:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789061713.292972:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789061713.293006:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789061713.293036:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789061713.293082:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789061713.293117:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789061713.293146:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789061713.293190:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789061713.293236:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789061713.293262:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789061713.293306:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789061713.293340:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789061713.293372:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789061713.293420:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789061713.293456:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789061713.293534:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789061713.293597:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789061713.293632:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789061713.293667:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789061713.293700:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789061713.293763:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789061713.293804:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789061713.293853:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789061713.293890:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789061713.293924:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789061713.293973:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789061713.294011:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789061713.294062:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789061713.294139:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061713.294176:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde0480 going to sleep for 11 seconds 00000100:00100000:0.0:1789061713.297909:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779554816 00000100:00100000:0.0:1789061713.297927:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779554816 00000100:00100000:0.0:1789061713.297982:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789061713.297992:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14973:x1875966779554816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789061713.298319:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14973:x1875966779554816:12345-0@lo:502:mount.lustre.0 Request processed in 326us (4177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061713.298327:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789061713.300743:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779554816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789061713.301286:0:14973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789061713.301303:0:14973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789061713.307094:0:14996:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789061713.307117:0:14996:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff971a760a8000) 00000020:00000080:3.0:1789061713.307140:0:14996:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789061713.307227:0:14996:0:(tgt_mount.c:153:server_get_mount()) get mount ffff971a56f4c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789061713.307231:0:14996:0:(tgt_mount.c:187:server_put_mount()) put mount ffff971a56f4c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789061713.307234:0:14996:0:(obd_mount.c:710:lustre_put_lsi()) put ffff971a56f4c000 3 00010000:00080000:3.0:1789061713.307275:0:14996:0:(ldlm_lib.c:102:import_set_conn()) imp ffff971a4d7d5000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1789061713.311307:0:14996:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789061713.311601:0:14996:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789061713.311645:0:14996:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789061713.311659:0:14996:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x427fa11dc4a9b8aa 00000100:00080000:3.0:1789061713.311670:0:14996:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789061713.311682:0:14996:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff971a4d7d5000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789061713.311719:0:14996:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971946bd3800 x1875966779554944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789061713.311772:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875966779554944:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789061713.315809:0:14996:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789061713.316877:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061713.317024:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779554944 00000100:00100000:2.0:1789061713.317034:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779554944 00000100:00100000:2.0:1789061713.317068:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061713.317077:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875966779554944:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789061713.317107:0:14291:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:2.0:1789061713.317142:0:14291:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x427fa11dc4a9b8b1 00000004:00100000:2.0:1789061713.317157:0:14291:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789061713.317192:0:14291:0:(import.c:65:import_set_state_nolock()) ffff97194505a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789061713.317269:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875966779554944:12345-0@lo:38:llog_process_th.0 Request processed in 191us (4971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061713.317276:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789061713.317325:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971946bd3800 x1875966779554944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789061723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061713.317336:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789061713.317344:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789061713.317352:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789061713.317357:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789061713.317359:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971a4d7d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789061713.317365:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875966779554944:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789061713.319992:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789061713.320004:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789061713.320007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789061713.320010:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789061713.320688:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061713.320706:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779555072:0@lo:400:kworker.0 00000100:00100000:3.0:1789061713.320778:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789061713.321586:0:14996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1789061713.322401:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779555072 00000100:00100000:0.0:1789061713.322411:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779555072 00000100:00100000:0.0:1789061713.322517:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789061713.322535:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779555072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061713.322629:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779555072:12345-0@lo:400:kworker.0 Request processed in 104us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061713.322637:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789061713.324656:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971947e4b480 x1875966779555072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061713.324675:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779555072:0@lo:400:kworker.0 00000020:01000000:0.0:1789061713.327028:0:14973:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789061713.327068:0:14973:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789061713.327131:0:14973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042c00/0x427fa11dc4a9b895 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b89c expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.327144:0:14973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a82042c00/0x427fa11dc4a9b895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b89c expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789061713.327204:0:14973:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789061713.327206:0:14973:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789061713.327207:0:14973:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061713.327208:0:14973:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061713.327210:0:14973:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061713.327211:0:14973:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061713.327212:0:14973:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789061713.327214:0:14973:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061713.327215:0:14973:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789061713.327219:0:14973:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789061713.327221:0:14973:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789061713.327222:0:14973:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789061713.327223:0:14973:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061713.327224:0:14973:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061713.327225:0:14973:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061713.327226:0:14973:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061713.327227:0:14973:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789061713.327228:0:14973:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061713.327229:0:14973:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789061713.327260:0:14973:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789061713.327281:0:14973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779555200:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789061713.327361:0:14973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061713.327403:0:14973:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde1540 going to sleep for 11 seconds 00000100:00100000:1.0:1789061713.327466:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779555200 00000100:00100000:1.0:1789061713.327474:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779555200 00000100:00100000:0.0:1789061713.327958:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789061713.327968:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14973:x1875966779555200:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789061713.327994:0:14283:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789061713.328012:0:14283:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789061713.404345:0:14283:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789061713.404381:0:14283:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789061713.404615:0:14307:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789061713.404622:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789061713.404661:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061713.405976:0:14307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9b825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b81e expref: 16 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061713.405991:0:14307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.410471:0:14307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9b825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9b81e expref: 16 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.410519:0:14307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9b825 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9b81e expref: 16 pid: 14283 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061713.410542:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14307:1875966779555328:0@lo:104: 00000100:00100000:0.0:1789061713.410653:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061713.410729:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061713.411010:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779555328 00000100:00100000:2.0:1789061713.411021:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779555328 00000100:00100000:2.0:1789061713.411251:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061713.411264:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d02fbc9-0efc-41a2-bf6f-922e38501192+3:14307:x1875966779555328:12345-0@lo:104: 00010000:00010000:2.0:1789061713.411281:0:14275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b825 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061713.411409:0:14275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789061713.411417:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d02fbc9-0efc-41a2-bf6f-922e38501192+3:14307:x1875966779555328:12345-0@lo:104: Request processed in 156us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061713.411425:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789061713.411571:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14307:1875966779555328:0@lo:104: 00010000:00010000:0.0:1789061713.411611:0:14307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.411632:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061713.411638:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b825 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.411646:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596dc00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061713.411651:0:14279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9b825 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.411661:0:14279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9b825 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061713.411670:0:14279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9b825 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061713.411678:0:14279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789061713.411721:0:14279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b825 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.411745:0:14279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789061713.411818:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779555456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061713.411858:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061713.411990:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b825 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.411998:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a7596dc00/0x427fa11dc4a9b81e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b825 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412025:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061713.412027:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061713.412028:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061713.412046:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779555456 00000100:00100000:0.0:1789061713.412052:0:14276:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779555456 00010000:00010000:0.0:1789061713.412075:0:14276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9b825 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b81e expref: 17 pid: 14283 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061713.412173:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789061713.412182:0:14276:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:3310:x1875966779555456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789061713.412201:0:14276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061713.412207:0:14276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9b825 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b81e expref: 17 pid: 14283 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412219:0:14276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9b825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9b81e expref: 17 pid: 14283 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412236:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a4f63ec00/0x427fa11dc4a9b825 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9b81e expref: 17 pid: 14283 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412253:0:14276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412274:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789061713.412290:0:14276:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008011720s 00010000:00010000:0.0:1789061713.412296:0:14276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412305:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412313:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412319:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412325:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061713.412329:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412338:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412352:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412362:0:14276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061713.412573:0:14276:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:3310:x1875966779555456:12345-0@lo:103:ldlm_bl.0 Request processed in 392us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061713.412593:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789061713.412639:0:14307:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412649:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061713.412667:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a82042800/0x427fa11dc4a9b8b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061713.413461:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779555456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061713.444070:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+15:14973:x1875966779555200:12345-0@lo:253:mount.lustre.0 Request processed in 116088us (116693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061713.444090:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789061713.444300:0:14973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:14973:1875966779555200:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789061713.444321:0:14973:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789061713.444326:0:14973:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789061713.444328:0:14973:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789061713.444329:0:14973:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061713.444331:0:14973:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061713.444332:0:14973:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061713.444334:0:14973:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061713.444336:0:14973:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789061713.444338:0:14973:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061713.444340:0:14973:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789061713.444362:0:14973:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789061713.453715:0:14973:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789061713.455621:0:14973:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789061713.455867:0:14973:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789061713.456032:0:14973:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789061713.456186:0:14973:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789061713.456416:0:14973:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789061713.464539:0:14973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789061713.579075:0:14973:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789061713.579088:0:14973:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789061713.579135:0:14973:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789061713.579232:0:14973:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789061713.579251:0:14973:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789061713.579292:0:14973:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789061714.302364:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789061714.622567:0:14288:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789061714.622574:0:14288:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97194517e000 from 7 10000000:01000000:3.0:1789061714.622579:0:14288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789061714.622640:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061714.622653:0:14288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061714.622664:0:14288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061714.622691:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779555584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789061714.622759:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061714.622809:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4349b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061714.623034:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779555584 00000100:00100000:0.0:1789061714.623043:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779555584 00000100:00100000:0.0:1789061714.623099:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789061714.623134:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+15:14288:x1875966779555584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061714.623147:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061714.623161:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596ca00/0x427fa11dc4a9b8c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b8bf expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061714.623183:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596ca00/0x427fa11dc4a9b8c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b8bf expref: 16 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061714.623194:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596ca00/0x427fa11dc4a9b8c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b8bf expref: 16 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061714.623203:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596ca00, rc 0) 00000100:00100000:0.0:1789061714.623254:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14288:x1875966779555584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061714.623262:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789061714.623593:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779555584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061714.623621:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b8c6 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061714.623644:0:14288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b8c6 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061714.623698:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779555712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789061714.623731:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061714.623762:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4349b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061714.624076:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779555712 00000100:00100000:2.0:1789061714.624082:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779555712 00000100:00100000:2.0:1789061714.624138:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789061714.624147:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14288:x1875966779555712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789061714.624166:0:14286:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789061714.624184:0:14286:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789061714.624191:0:14286:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789061714.624293:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14288:x1875966779555712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 147us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061714.624300:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789061714.627054:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779555712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789061714.627216:0:14288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789061714.627228:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b8c6 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061714.627241:0:14288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b8c6 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061715.326360:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061716.357949:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061717.376377:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061718.399054:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789061718.782446:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789061718.782463:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789061718.782467:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789061718.782471:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789061718.782567:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d02fbc9-0efc-41a2-bf6f-922e38501192:3311:1875966779555840:0@lo:400:kworker.0 00000100:00100000:3.0:1789061718.782663:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061718.782876:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779555968:0@lo:400:kworker.0 00000100:00100000:3.0:1789061718.782925:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061718.782955:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061718.782977:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779556096:0@lo:400:kworker.0 00000100:00100000:3.0:1789061718.783008:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061718.783055:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779555840 00000100:00100000:3.0:1789061718.783063:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779555840 00000100:00100000:3.0:1789061718.783114:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789061718.783124:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:3311:x1875966779555840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061718.783178:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:3311:x1875966779555840:12345-0@lo:400:kworker.0 Request processed in 55us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061718.783187:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789061718.783234:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779555968 00000100:00100000:3.0:1789061718.783239:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779555968 00000100:00100000:3.0:1789061718.783369:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779556096 00000100:00100000:3.0:1789061718.783373:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779556096 00000100:00100000:3.0:1789061718.783410:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789061718.783419:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779555968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061718.783468:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779555968:12345-0@lo:400:kworker.0 Request processed in 49us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061718.783513:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789061718.783535:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061718.783544:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779556096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061718.783581:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779556096:12345-0@lo:400:kworker.0 Request processed in 40us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061718.783590:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789061718.784085:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971946bd3800 x1875966779556096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061718.784100:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779556096:0@lo:400:kworker.0 00010000:00080000:3.0:1789061718.784137:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971946bd3b80 x1875966779555968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061718.784147:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779555968:0@lo:400:kworker.0 00000100:00100000:3.0:1789061718.784199:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d02fbc9-0efc-41a2-bf6f-922e38501192:3311:1875966779555840:0@lo:400:kworker.0 00000100:00080000:1.0:1789061718.790044:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789061719.421825:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061720.447726:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789061720.766218:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1789061721.442256:0:15340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789061721.469993:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061722.496175:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061723.518331:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061723.582314:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789061708/real 1789061708] req@ffff971946bd0e00 x1875966779552384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789061723 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061723.582343:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff971946bd0e00 x1875966779552384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789061723 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061723.582353:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789061708/real 1789061708] req@ffff971946bd0a80 x1875966779552512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789061723 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061723.582363:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff971946bd0a80 x1875966779552512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789061723 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789061723.582391:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971a7618b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789061723.582415:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789061723.582419:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779552384:0@lo:8:kworker.0 00000100:00080000:3.0:1789061723.582425:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971946bc9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789061723.582430:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789061723.582433:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779552512:0@lo:8:kworker.0 00000100:00080000:2.0:1789061723.582577:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789061723.582581:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789061723.582584:0:8:0:(import.c:65:import_set_state_nolock()) ffff971a7618b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789061723.582589:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:2.0:1789061723.582593:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789061723.582604:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff971a7618b800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789061723.582624:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971946cde680 x1875966779556352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789061723.582639:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789061723.582643:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789061723.582644:0:8:0:(import.c:65:import_set_state_nolock()) ffff971946bc9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789061723.582647:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:2.0:1789061723.582650:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789061723.582654:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff971946bc9800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789061723.582665:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971946cdc700 x1875966779556480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789061723.582721:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779556736:0@lo:400:kworker.0 00000100:00100000:2.0:1789061723.582804:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061723.582869:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779556736 00000100:00100000:2.0:1789061723.582877:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779556736 00000100:00100000:2.0:1789061723.582925:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789061723.582934:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779556736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061723.582986:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779556736:12345-0@lo:400:kworker.0 Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061723.582992:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789061723.583025:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971946cdd500 x1875966779556736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061723.583037:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779556736:0@lo:400:kworker.0 00000100:00100000:2.0:1789061723.583054:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779556352:0@lo:8:kworker.0 00000100:00100000:2.0:1789061723.583080:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061723.583109:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779556480:0@lo:8:kworker.0 00000100:00100000:2.0:1789061723.583131:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061723.583198:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779556224:0@lo:400:kworker.0 00000100:00100000:3.0:1789061723.583233:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061723.583269:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061723.583275:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779556608:0@lo:400:kworker.0 00000100:00100000:3.0:1789061723.583296:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061723.583320:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779556608 00000100:00100000:3.0:1789061723.583324:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779556608 00000100:00100000:3.0:1789061723.583345:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789061723.583351:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779556608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061723.583393:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875966779556608:12345-0@lo:400:kworker.0 Request processed in 42us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061723.583399:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789061723.583425:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971946cdd180 x1875966779556608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061723.583434:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875966779556608:0@lo:400:kworker.0 00000100:00080000:1.0:1789061723.583550:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061723.583570:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779556352 00000100:00100000:1.0:1789061723.583579:0:14976:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779556352 00000100:00100000:1.0:1789061723.583609:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779556480 00000100:00100000:1.0:1789061723.583612:0:14976:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779556480 00000100:00100000:1.0:1789061723.583622:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061723.583627:0:14976:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875966779556352:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789061723.583646:0:14976:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:1.0:1789061723.583673:0:14976:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x427fa11dc4a9b8cd 00002000:00100000:1.0:1789061723.583686:0:14976:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff971947568800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789061723.583690:0:14976:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789061723.583693:0:14976:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789061723.584018:0:14976:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789061723.584040:0:14976:0:(import.c:65:import_set_state_nolock()) ffff971947568000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061723.584086:0:14976:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875966779556352:12345-0@lo:8:kworker.0 Request processed in 456us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061723.584093:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061723.584108:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789061723.584112:0:14976:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875966779556480:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789061723.584123:0:14976:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789061723.584154:0:14976:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875966779556480:12345-0@lo:8:kworker.0 Request processed in 41us (1021us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789061723.584159:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789061723.584190:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971946cde680 x1875966779556352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789061743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061723.584198:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789061723.584204:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789061723.584210:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789061723.584222:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789061723.584224:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971a7618b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789061723.584236:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789061723.584241:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779556352:0@lo:8:kworker.0 00000100:00080000:1.0:1789061723.584257:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971946bc9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789061723.584260:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789061723.584263:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779556480:0@lo:8:kworker.0 00000004:00080000:1.0:1789061723.584311:0:14314:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789061723.584327:0:14314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14314:1875966779556992:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789061723.584352:0:14314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061723.584365:0:14314:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a456bdcc0 going to sleep for 11 seconds 00000004:00080000:1.0:1789061723.584403:0:14313:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789061723.584612:0:14313:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 497826123265ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789061723.584815:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779556864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061723.584841:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061723.584872:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779556864 00000100:00100000:1.0:1789061723.584876:0:14978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779556864 00000100:00100000:1.0:1789061723.584903:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061723.584908:0:14978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779556864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061723.584928:0:14978:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061723.584957:0:14978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875966779556864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061723.584963:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789061723.584978:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061723.584999:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9719453e6d80 x1875966779556864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061723.585024:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779556864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061723.585392:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779556992 00000100:00100000:1.0:1789061723.585397:0:14976:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779556992 00000100:00100000:1.0:1789061723.585416:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789061723.585422:0:14976:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14314:x1875966779556992:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789061723.586858:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779556224 00000100:00100000:2.0:1789061723.586871:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779556224 00000100:00100000:2.0:1789061723.586910:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789061723.586919:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:3310:x1875966779556224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061723.587001:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:3310:x1875966779556224:12345-0@lo:400:kworker.0 Request processed in 83us (3765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061723.587007:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789061723.587084:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779556224:0@lo:400:kworker.0 00002000:00080000:1.0:1789061723.593819:0:14976:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789061723.593831:0:14976:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789061723.593838:0:14976:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1789061723.614737:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789061723.614748:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e9f69c9/0x427fa11dc4a9b8d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.614766:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=497s v=(0 0) 00010000:00010000:1.0:1789061723.614772:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061723.614779:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e9f69c9/0x427fa11dc4a9b8d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.614797:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e9f69c9/0x427fa11dc4a9b8d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.614808:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e9f69c9/0x427fa11dc4a9b8d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.614816:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e9f69c9/0x427fa11dc4a9b8d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.614847:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789061723.615305:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789061723.615312:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9b8db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.615321:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=497s v=(0 0) 00010000:00010000:1.0:1789061723.615324:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061723.615329:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9b8db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.615338:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9b8db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.615346:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9b8db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.615433:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9b8db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.615447:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789061723.616228:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789061723.616238:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e9f69c9/0x427fa11dc4a9b8d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616320:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061723.616326:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e9f69c9/0x427fa11dc4a9b8d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616336:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e9f69c9/0x427fa11dc4a9b8d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616356:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e9f69c9/0x427fa11dc4a9b8d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616364:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e9f69c9/0x427fa11dc4a9b8d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061723.616774:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789061723.616782:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9b8e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.616790:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=497s v=(0 0) 00010000:00010000:1.0:1789061723.616800:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061723.616805:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9b8e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.616817:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9b8e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616823:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061723.616826:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9b8e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616830:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9b8db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.616836:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9b8e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.616850:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061723.616852:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061723.616858:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9b8db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616868:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9b8db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616882:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9b8db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616897:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9b8db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616913:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061723.616918:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9b8e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616925:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061723.616929:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9b8e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616937:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9b8e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616947:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9b8e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616956:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028c2b66c/0x427fa11dc4a9b8e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.616969:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061723.616971:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061723.616975:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789061723.617261:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789061723.617268:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9b8e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.617277:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=497s v=(0 0) 00010000:00010000:1.0:1789061723.617280:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061723.617284:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9b8e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.617292:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9b8e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.617301:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9b8e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.617316:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9b8e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.617343:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061723.617562:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061723.617568:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9b8e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.617582:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061723.617587:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9b8e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.617595:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9b8e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.617607:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9b8e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.617614:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aad4aa87/0x427fa11dc4a9b8e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.617628:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061723.617630:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061723.617631:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.620210:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789061723.620793:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789061723.620804:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004adddd4b/0x427fa11dc4a9b8f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.620821:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=497s v=(0 0) 00010000:00010000:1.0:1789061723.620826:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061723.620831:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004adddd4b/0x427fa11dc4a9b8f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.620845:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004adddd4b/0x427fa11dc4a9b8f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.620855:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004adddd4b/0x427fa11dc4a9b8f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.620862:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004adddd4b/0x427fa11dc4a9b8f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.620928:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789061723.621335:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789061723.621341:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b8f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.621356:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=497s v=(0 0) 00010000:00010000:1.0:1789061723.621358:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061723.621362:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b8f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.621371:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b8f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.621388:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b8f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.621396:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b8f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.627684:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789061723.627707:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004adddd4b/0x427fa11dc4a9b8f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.627721:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525e00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.627726:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004adddd4b/0x427fa11dc4a9b8f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.627737:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004adddd4b/0x427fa11dc4a9b8f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.627762:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004adddd4b/0x427fa11dc4a9b8f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.627781:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004adddd4b/0x427fa11dc4a9b8f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.627827:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061723.627830:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b8f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.627836:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.627839:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b8f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.627846:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b8f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.627856:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b8f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.627864:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.627865:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.627867:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.628657:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789061723.628668:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a28073d0/0x427fa11dc4a9b8f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789061723.635100:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.635116:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b8fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.635135:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.635139:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.635148:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b8fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.635163:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b8fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.635183:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b8fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.635191:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b8fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.637859:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789061723.639328:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061723.639341:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b8fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.639365:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fa00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061723.639370:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b8fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.639407:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b8fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.639429:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b8fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.639437:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b8fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.639462:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.639464:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.639465:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061723.640560:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.640571:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.640585:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.640590:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.640596:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.640612:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.640621:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.640628:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.640654:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789061723.643611:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.643625:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b90c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.643642:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.643647:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.643654:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b90c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.644315:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b90c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.644330:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b90c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.644338:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b90c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.644424:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789061723.647975:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.647989:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b913 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.648009:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.648020:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.648027:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.648042:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.648052:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.648060:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789061723.648078:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1789061723.648229:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789061723.648237:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648247:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.648258:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648268:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648286:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b905 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648294:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b905 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648373:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789061723.648378:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b90c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648395:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e200 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.648398:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b90c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648406:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b90c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648416:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b90c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648422:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b90c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648442:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061723.648446:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648452:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ec00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.648455:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648462:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b913 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648472:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b913 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.648481:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.648483:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.650018:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061723.651626:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789061723.651645:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b913 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789061723.653303:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.653319:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b91a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.653338:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.653344:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.653350:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b91a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.653366:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b91a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.653396:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b91a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.653405:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b91a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.653420:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789061723.654215:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.654224:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.654235:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.654239:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.654373:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.654398:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.654408:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.654416:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.654460:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061723.654470:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b91a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.654480:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.654484:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b91a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.654513:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b91a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.654518:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789061723.654546:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b91a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.654555:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b91a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.654599:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061723.654604:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.654611:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f000 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.654615:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.654623:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.654634:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b921 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.654641:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b921 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.654658:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.654662:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.654669:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061723.655021:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.655027:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b928 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.655036:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.655039:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.655043:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.655051:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.655059:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.655066:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.655089:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789061723.655376:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061723.655393:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.655400:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ea00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061723.655405:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.655413:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.655428:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b928 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.655454:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b928 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.655555:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.655557:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.655558:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.655717:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061723.656393:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.656401:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b92f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.656413:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.656424:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.656429:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b92f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.656451:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b92f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.656460:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b92f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.656467:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b92f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.656511:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789061723.657368:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.657376:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b936 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.657397:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.657401:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.657406:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.657417:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.657426:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.657520:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.657538:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789061723.657875:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789061723.657883:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b92f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.657892:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.657897:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b92f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.657905:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b92f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.657922:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b92f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.657930:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b92f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.657951:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061723.657955:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.657962:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.657965:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.657986:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b936 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.657997:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b936 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.658004:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b936 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.658022:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.658025:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.658026:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061723.658101:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.658107:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b93d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.658116:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.658120:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.658124:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b93d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.658135:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b93d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.658144:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b93d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.658151:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b93d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.658173:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789061723.658199:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061723.658205:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b93d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.658214:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.658217:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b93d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.658225:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b93d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.658238:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b93d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.658258:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b93d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.658272:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.658274:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.658275:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.658411:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061723.660104:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.660117:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b944 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.660139:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.660144:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.660150:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.660165:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.660176:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.660185:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.660347:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789061723.660713:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061723.660722:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.660732:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fc00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.660737:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.660748:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.660766:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b944 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.660773:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b944 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.660791:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.660794:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.660795:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061723.661121:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.661127:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b94b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.661135:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.661139:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.661143:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b94b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.661154:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b94b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.661173:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b94b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.661179:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b94b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.661517:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789061723.662102:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.662110:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b952 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.662122:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.662125:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.662130:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.662140:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.662149:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.662158:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.662389:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789061723.662397:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b94b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.662405:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ea00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061723.662410:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b94b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.662420:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b94b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.662548:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789061723.662614:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061723.662762:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b94b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.662771:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aadf1e70/0x427fa11dc4a9b94b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.663337:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.663340:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.663347:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061723.663702:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.663710:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b959 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.663722:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.663726:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.663730:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.663741:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.663751:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.663759:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.663780:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789061723.664109:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061723.664115:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.664123:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ec00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061723.664127:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.664137:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.664152:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b959 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.664160:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bee15664/0x427fa11dc4a9b959 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.664175:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.664176:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.664178:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061723.664620:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.664627:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b960 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.664638:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.664647:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.664652:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.664675:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.664685:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.664692:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.664708:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789061723.664924:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061723.664929:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.664937:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061723.664941:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.664960:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b960 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.664973:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b960 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.664980:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000338640e8/0x427fa11dc4a9b960 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.664999:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.665001:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.665003:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061723.669455:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.669467:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b967 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.669484:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.669517:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.669525:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.669542:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.669554:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.669568:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b967 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.669586:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789061723.670547:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.670555:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b96e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.670610:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061723.670617:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b967 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.670626:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fa00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.670631:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b967 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.670640:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b967 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.670662:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b967 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.670670:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000098287fd/0x427fa11dc4a9b967 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.670685:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.670687:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.670689:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061723.670789:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.670793:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.670798:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b96e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.670809:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b96e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.670818:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b96e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.670826:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b96e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.670848:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789061723.674465:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061723.674481:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b96e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.674508:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.674513:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b96e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.674547:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b96e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.674568:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b96e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.674576:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0a3169b/0x427fa11dc4a9b96e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.674604:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.674606:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.674607:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061723.675080:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.675090:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b975 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.675109:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.675113:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.675119:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.675132:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.675142:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.675151:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.675181:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789061723.675837:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.675844:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b97c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.675853:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.675856:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.675860:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b97c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.675870:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b97c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.675890:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b97c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.675898:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b97c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.675906:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789061723.676403:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789061723.676411:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.676420:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.676425:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.676434:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b975 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.676453:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b975 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.676471:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075702816/0x427fa11dc4a9b975 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.676505:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061723.676509:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b97c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.676516:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.676519:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b97c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.676527:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b97c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.676537:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b97c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.676544:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009be0c231/0x427fa11dc4a9b97c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.676558:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.676560:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.676561:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.677549:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.677819:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.677834:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e200 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061723.677838:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.677849:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.677866:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b952 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.677885:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e56192f/0x427fa11dc4a9b952 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.677903:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.677905:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.677907:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061723.678555:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.678565:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b983 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.678578:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.678582:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.678588:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.678600:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.678610:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.678617:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.678649:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789061723.679129:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061723.679137:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.679153:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f000 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061723.679158:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.679166:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b983 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.679181:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b983 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.679188:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d67d8bc/0x427fa11dc4a9b983 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061723.679207:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.679209:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061723.679211:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061723.682808:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.682823:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b98a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.682839:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.682844:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.682850:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b98a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.682865:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b98a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.682876:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b98a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.682885:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b98a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.682916:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789061723.683360:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061723.683367:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b98a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.683376:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061723.683390:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b98a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.683400:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b98a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.683418:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b98a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.683426:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e6a65e/0x427fa11dc4a9b98a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.683446:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.683448:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.683450:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061723.683910:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061723.683917:0:14976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b991 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.683927:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1789061723.683937:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061723.683942:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.683952:0:14976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.683961:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.683969:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061723.685363:0:14976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789061723.685715:0:14976:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1789061723.685823:0:14976:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14314:x1875966779556992:12345-0@lo:5:osp-pre-0-0.0 Request processed in 100395us (101465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061723.685849:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789061723.688566:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061723.688582:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.688597:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fc00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061723.688602:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.688613:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b991 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.688635:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b991 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.688643:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9b991 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061723.688665:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.688666:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061723.688668:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061723.688721:0:14314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14314:1875966779556992:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789061723.688737:0:14314:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789061723.688785:0:14314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14314:1875966779557120:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789061723.688838:0:14314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061723.688885:0:14314:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789061723.690411:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779557120 00000100:00100000:3.0:1789061723.690424:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779557120 00000100:00100000:3.0:1789061723.690473:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061723.690483:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14314:x1875966779557120:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789061723.690549:0:14977:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1789061723.701033:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14314:x1875966779557120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10544us (12186us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789061723.701046:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789061723.704709:0:14314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14314:1875966779557120:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789061723.704741:0:14314:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:2.0:1789061724.039245:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789061724.039291:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1789061724.551521:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061725.574738:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061726.591819:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061727.613711:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061728.638702:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061729.025742:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779557248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061729.025809:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.026376:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779557248 00000100:00100000:1.0:1789061729.026386:0:14978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779557248 00000100:00100000:1.0:1789061729.026443:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789061729.026452:0:14978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779557248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061729.026512:0:14978:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061729.026568:0:14978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779557248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061729.026574:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789061729.026596:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061729.026626:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789061729.026648:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779557248:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789061729.026897:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789061729.026902:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789061729.026905:0:8:0:(import.c:65:import_set_state_nolock()) ffff971946bc9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789061729.026910:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:0.0:1789061729.026915:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789061729.026923:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff971946bc9800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789061729.026942:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971947e48e00 x1875966779557504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789061729.027188:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779557504:0@lo:8:kworker.0 00000100:00100000:1.0:1789061729.027221:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061729.027477:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779557504 00000100:00100000:2.0:1789061729.027482:0:14976:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779557504 00000100:00100000:2.0:1789061729.027523:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789061729.027529:0:14976:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875966779557504:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789061729.027555:0:14976:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789061729.030797:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d02fbc9-0efc-41a2-bf6f-922e38501192:3311:1875966779557376:0@lo:400:kworker.0 00000100:00100000:0.0:1789061729.030906:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061729.031373:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779557376 00000100:00100000:3.0:1789061729.031382:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779557376 00000100:00100000:3.0:1789061729.031435:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789061729.031444:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:3311:x1875966779557376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061729.032393:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:3311:x1875966779557376:12345-0@lo:400:kworker.0 Request processed in 945us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061729.032403:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789061729.032642:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779557632:0@lo:400:kworker.0 00000100:00100000:1.0:1789061729.032685:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.032716:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061729.032724:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779557760:0@lo:400:kworker.0 00000100:00100000:1.0:1789061729.032749:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.032796:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779557632 00000100:00100000:1.0:1789061729.032803:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779557632 00000100:00100000:1.0:1789061729.032836:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779557760 00000100:00100000:1.0:1789061729.032839:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779557760 00000100:00100000:1.0:1789061729.032861:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789061729.032866:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779557632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061729.032924:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779557632:12345-0@lo:400:kworker.0 Request processed in 57us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061729.032930:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789061729.032942:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789061729.032947:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779557760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061729.032972:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779557760:12345-0@lo:400:kworker.0 Request processed in 25us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061729.032977:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789061729.033009:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971947e48380 x1875966779557760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061729.033023:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779557760:0@lo:400:kworker.0 00010000:00080000:1.0:1789061729.033034:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff971947e4ad80 x1875966779557632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061729.033042:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779557632:0@lo:400:kworker.0 00000100:00080000:1.0:1789061729.033328:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061729.033357:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d02fbc9-0efc-41a2-bf6f-922e38501192:3311:1875966779557376:0@lo:400:kworker.0 00000100:00100000:2.0:1789061729.078783:0:14976:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875966779557504:12345-0@lo:8:kworker.0 Request processed in 51242us (51550us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789061729.078801:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789061729.089269:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971946bc9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789061729.089294:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789061729.089299:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779557504:0@lo:8:kworker.0 00000020:01000004:2.0:1789061729.338889:0:15694:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789061729.338894:0:15694:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789061729.339008:0:15694:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97194505f000 00000020:01000004:2.0:1789061729.339024:0:15694:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789061729.339038:0:15694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789061729.339052:0:15694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff971a8011b380) 00000020:00000080:2.0:1789061729.339069:0:15694:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789061729.367957:0:15694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789061729.368240:0:15694:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789061729.370073:0:15694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789061729.370298:0:15694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789061729.370783:0:15694:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789061729.371155:0:15694:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:3.0:1789061729.371253:0:15694:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 529: rc = 0 00100000:10000000:3.0:1789061729.371364:0:15694:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 529: rc = 0 00100000:10000000:3.0:1789061729.372072:0:15694:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 899: rc = 0 00100000:10000000:3.0:1789061729.372326:0:15694:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 899: rc = 0 00100000:10000000:3.0:1789061729.373123:0:15694:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 899: rc = 0 00100000:10000000:3.0:1789061729.373404:0:15694:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 899: rc = 0 00100000:10000000:3.0:1789061729.374093:0:15694:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 899: rc = 0 00100000:10000000:3.0:1789061729.375434:0:15694:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 899: rc = 0 00000020:00000080:3.0:1789061729.376248:0:15694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789061729.376262:0:15694:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789061729.376286:0:15694:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x427fa11dc4a9b99f 00000020:01000004:3.0:1789061729.376294:0:15694:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789061729.376324:0:15694:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789061729.376328:0:15694:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789061729.376333:0:15694:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789061729.376355:0:15694:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789061729.376359:0:15694:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789061729.395204:0:15694:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789061729.395249:0:15694:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789061729.395254:0:15694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789061729.395256:0:15694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789061729.395257:0:15694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061729.395259:0:15694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061729.395260:0:15694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061729.395261:0:15694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061729.395263:0:15694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061729.395264:0:15694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061729.395266:0:15694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789061729.395281:0:15694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789061729.395284:0:15694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789061729.395285:0:15694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789061729.395286:0:15694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061729.395288:0:15694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061729.395289:0:15694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061729.395290:0:15694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061729.395291:0:15694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061729.395292:0:15694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061729.395293:0:15694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789061729.395320:0:15694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789061729.395341:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779557888:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789061729.395426:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061729.395830:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47cbd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061729.395984:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779557888 00000100:00100000:3.0:1789061729.395992:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779557888 00000100:00100000:3.0:1789061729.396080:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789061729.396090:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:15694:x1875966779557888:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789061729.396119:0:14286:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789061729.396122:0:14286:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789061729.396126:0:14286:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789061729.405470:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:15694:x1875966779557888:12345-0@lo:253:mount.lustre.0 Request processed in 9372us (10033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061729.405506:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789061729.408346:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779557888:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789061729.408367:0:15694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789061729.408371:0:15694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789061729.408372:0:15694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789061729.408374:0:15694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061729.408375:0:15694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789061729.408376:0:15694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061729.408405:0:15694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061729.408406:0:15694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789061729.408408:0:15694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061729.408410:0:15694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789061729.408432:0:15694:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97194505f000 from lustre-OST0001 10000000:01000000:1.0:1789061729.408463:0:15694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789061729.408466:0:15694:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789061729.408474:0:15694:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff971a7c734d40 local copy 00010000:00010000:1.0:1789061729.408509:0:15694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596c600/0x427fa11dc4a9b745 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b74c expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061729.408924:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789061729.408995:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.409087:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789061729.409257:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779558016 00000100:00100000:3.0:1789061729.409265:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779558016 00000100:00100000:3.0:1789061729.409365:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789061729.409375:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:15694:x1875966779558016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789061729.409618:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:15694:x1875966779558016:12345-0@lo:501:mount.lustre.0 Request processed in 244us (622us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789061729.409625:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789061729.409695:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558016:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789061729.409708:0:15694:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789061729.409831:0:15694:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789061729.409838:0:15694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7596c600/0x427fa11dc4a9b745 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b74c expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061729.409849:0:15694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7596c600/0x427fa11dc4a9b745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b74c expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061729.409870:0:15694:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97194505f000 10000000:01000000:1.0:1789061729.409875:0:15694:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789061729.409880:0:15694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789061729.409883:0:15694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789061729.409887:0:15694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789061729.409890:0:15694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789061729.409912:0:15694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9b9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061729.409926:0:15694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9b9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061729.409937:0:15694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9b9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061729.409950:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789061729.409977:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.410885:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789061729.411153:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779558144 00000100:00100000:0.0:1789061729.411161:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779558144 00000100:00100000:0.0:1789061729.411201:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789061729.411209:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75af6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:15694:x1875966779558144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789061729.411222:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061729.411237:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596dc00/0x427fa11dc4a9b9ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b9a6 expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061729.411261:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596dc00/0x427fa11dc4a9b9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b9a6 expref: 17 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061729.411282:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596dc00/0x427fa11dc4a9b9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b9a6 expref: 17 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061729.411292:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596dc00, rc 0) 00000100:00100000:0.0:1789061729.411345:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75af6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:15694:x1875966779558144:12345-0@lo:101:mount.lustre.0 Request processed in 137us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061729.411351:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789061729.411701:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789061729.411728:0:15694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9b9a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b9ad expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061729.411738:0:15694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9b9a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b9ad expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789061729.412437:0:15694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789061729.413637:0:15694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789061729.413905:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789061729.413944:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789061729.413970:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789061729.414007:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789061729.414035:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789061729.414073:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789061729.414139:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789061729.414147:0:15694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789061729.414228:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789061729.414318:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.414379:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26540 going to sleep for 11 seconds 00000100:00100000:1.0:1789061729.417504:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779558272 00000100:00100000:1.0:1789061729.417519:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779558272 00000100:00100000:1.0:1789061729.417574:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789061729.417725:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75af5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:15694:x1875966779558272:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789061729.418889:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75af5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:15694:x1875966779558272:12345-0@lo:501:mount.lustre.0 Request processed in 1305us (4570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061729.418900:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789061729.418974:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789061729.419032:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789061729.419344:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.419380:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26540 going to sleep for 11 seconds 00000100:00100000:0.0:1789061729.419734:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779558400 00000100:00100000:0.0:1789061729.419741:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779558400 00000100:00100000:0.0:1789061729.419775:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789061729.419783:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75af7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:15694:x1875966779558400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789061729.420822:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75af7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:15694:x1875966779558400:12345-0@lo:503:mount.lustre.0 Request processed in 1032us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061729.420834:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789061729.421179:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558400:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789061729.426857:0:15694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789061729.426971:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789061729.427141:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.427195:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26540 going to sleep for 11 seconds 00000100:00100000:3.0:1789061729.428317:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779558528 00000100:00100000:3.0:1789061729.428329:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779558528 00000100:00100000:3.0:1789061729.428403:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789061729.428414:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75af6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:15694:x1875966779558528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789061729.428904:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75af6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:15694:x1875966779558528:12345-0@lo:502:mount.lustre.0 Request processed in 490us (1839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061729.428912:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789061729.429919:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789061729.430801:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789061729.430873:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789061729.430911:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789061729.430980:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789061729.431023:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789061729.431059:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789061729.432349:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789061729.436840:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789061729.437025:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789061729.437095:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789061729.437186:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.437243:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26540 going to sleep for 11 seconds 00000100:00100000:3.0:1789061729.437983:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779558656 00000100:00100000:3.0:1789061729.437993:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779558656 00000100:00100000:3.0:1789061729.438067:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789061729.438078:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75af7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:15694:x1875966779558656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789061729.438338:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75af7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:15694:x1875966779558656:12345-0@lo:502:mount.lustre.0 Request processed in 262us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061729.438346:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789061729.438924:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789061729.439022:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789061729.439034:0:15694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789061729.441704:0:15695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789061729.441717:0:15695:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789061729.441724:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061729.441726:0:15695:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789061729.441736:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789061729.441751:0:15695:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff971a801199c0) 00000020:00000080:2.0:1789061729.441775:0:15695:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789061729.441781:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789061729.441855:0:15695:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97194505f000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789061729.441863:0:15695:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789061729.441871:0:15695:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x427fa11dc4a9b9bb 00010000:00010000:2.0:1789061729.456261:0:15695:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789061729.456990:0:15695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789061729.459073:0:15695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789061729.468448:0:15695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789061729.468461:0:15695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061729.468474:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061729.468477:0:15695:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789061729.468482:0:15695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061729.468508:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061729.468510:0:15695:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789061729.468514:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789061729.468516:0:15695:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789061729.468519:0:15695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061729.468522:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061729.468523:0:15695:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789061729.468526:0:15695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061729.468528:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061729.468530:0:15695:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789061729.468534:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789061729.468597:0:15695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061729.468600:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061729.468602:0:15695:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789061729.468605:0:15695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789061729.469666:0:15694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789061729.469698:0:15694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789061729.469723:0:15694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9b9a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b9ad expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061729.469735:0:15694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7c525e00/0x427fa11dc4a9b9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b9ad expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061729.469743:0:15694:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97194505f000 from 1 10000000:01000000:2.0:1789061729.469745:0:15694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789061729.469784:0:15694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061729.469802:0:15694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061729.469813:0:15694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061729.469839:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789061729.469910:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061729.470062:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a45634180 going to sleep for 11 seconds 00000100:00100000:1.0:1789061729.470159:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779558784 00000100:00100000:1.0:1789061729.470167:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779558784 00000100:00100000:1.0:1789061729.470265:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789061729.470288:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75af4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:15694:x1875966779558784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789061729.470301:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061729.470314:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9b9c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b9c2 expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061729.470339:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9b9c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b9c2 expref: 18 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061729.470351:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9b9c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b9c2 expref: 18 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061729.470360:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524600, rc 0) 00000100:00100000:1.0:1789061729.470413:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75af4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:15694:x1875966779558784:12345-0@lo:101:mount.lustre.0 Request processed in 127us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061729.470420:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789061729.470453:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789061729.470468:0:15694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b9c9 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061729.470478:0:15694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b9c9 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789061729.477325:0:15694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789061729.477925:0:15694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061729.478170:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789061729.478219:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789061729.478303:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789061729.478313:0:15694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789061729.478391:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789061729.478466:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061729.478537:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d436f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061729.478542:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779558912 00000100:00100000:2.0:1789061729.478550:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779558912 00000100:00100000:2.0:1789061729.478604:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789061729.478615:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75af6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:15694:x1875966779558912:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789061729.478832:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75af6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:15694:x1875966779558912:12345-0@lo:501:mount.lustre.0 Request processed in 219us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061729.478839:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789061729.478966:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779558912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789061729.479007:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789061729.479049:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.479128:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061729.479186:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779559040 00000100:00100000:2.0:1789061729.479191:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779559040 00000100:00100000:2.0:1789061729.479216:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789061729.479222:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75af4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:15694:x1875966779559040:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789061729.479410:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75af4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:15694:x1875966779559040:12345-0@lo:503:mount.lustre.0 Request processed in 188us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061729.479416:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789061729.480330:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559040:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789061729.481105:0:15694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789061729.481186:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559168:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789061729.481251:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.481337:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061729.481598:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779559168 00000100:00100000:2.0:1789061729.481606:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779559168 00000100:00100000:2.0:1789061729.481772:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789061729.481791:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75af7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:15694:x1875966779559168:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789061729.481980:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75af7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:15694:x1875966779559168:12345-0@lo:502:mount.lustre.0 Request processed in 192us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061729.481988:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789061729.482177:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559168:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789061729.482419:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789061729.482471:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789061729.482558:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789061729.482596:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789061729.482643:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789061729.482758:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789061729.482797:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789061729.482829:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789061729.482861:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789061729.482906:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.482934:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061729.483052:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779559296 00000100:00100000:2.0:1789061729.483058:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779559296 00000100:00100000:2.0:1789061729.483096:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789061729.483104:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:15694:x1875966779559296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789061729.483379:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789061729.483459:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789061729.483469:0:15694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000100:00100000:2.0:1789061729.483752:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:15694:x1875966779559296:12345-0@lo:502:mount.lustre.0 Request processed in 144us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061729.483761:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000020:01000000:3.0:1789061729.484408:0:15699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061729.484419:0:15699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061729.484421:0:15699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789061729.484428:0:15699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97194505f000 00000020:00000080:3.0:1789061729.484431:0:15699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789061729.484439:0:15699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061729.484441:0:15699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061729.484443:0:15699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789061729.484445:0:15699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061729.484447:0:15699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061729.484447:0:15699:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789061729.484450:0:15699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97194505f000 00000020:00000080:3.0:1789061729.484452:0:15699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789061729.487813:0:15699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061729.487830:0:15699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061729.487832:0:15699:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789061729.487838:0:15699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061729.487843:0:15699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061729.487845:0:15699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789061729.487851:0:15699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97194505f000 00000020:00000080:3.0:1789061729.487853:0:15699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789061729.487957:0:15699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061729.487962:0:15699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061729.487963:0:15699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789061729.487967:0:15699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789061729.488163:0:15694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789061729.488193:0:15694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789061729.488215:0:15694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b9c9 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061729.488229:0:15694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b9c9 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061729.488306:0:15694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789061729.488309:0:15694:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97194505f000 10000000:01000000:1.0:1789061729.488312:0:15694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97194505f000 10000000:01000000:1.0:1789061729.488317:0:15694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789061729.488322:0:15694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97194505f000 from 1 10000000:01000000:1.0:1789061729.488325:0:15694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789061729.488360:0:15694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c524200/0x427fa11dc4a9b9d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061729.488369:0:15694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7c524200/0x427fa11dc4a9b9d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061729.488380:0:15694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7c524200/0x427fa11dc4a9b9d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061729.488406:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789061729.488471:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061729.488541:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779559424 00000100:00100000:1.0:1789061729.488545:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061729.488549:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779559424 00000100:00100000:2.0:1789061729.488601:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789061729.488611:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:15694:x1875966779559424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789061729.488626:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061729.488659:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63f800/0x427fa11dc4a9b9d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b9d0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061729.488845:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63f800/0x427fa11dc4a9b9d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b9d0 expref: 19 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061729.488861:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63f800/0x427fa11dc4a9b9d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b9d0 expref: 19 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061729.488870:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f800, rc 0) 00000100:00100000:2.0:1789061729.488922:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:15694:x1875966779559424:12345-0@lo:101:mount.lustre.0 Request processed in 313us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061729.488940:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789061729.490971:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789061729.490997:0:15694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7c524200/0x427fa11dc4a9b9d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b9d7 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061729.491009:0:15694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7c524200/0x427fa11dc4a9b9d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9b9d7 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789061729.491688:0:15694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789061729.491971:0:15694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789061729.492206:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789061729.492261:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789061729.492310:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789061729.492361:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789061729.492399:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789061729.492446:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789061729.492484:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789061729.492542:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789061729.492599:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789061729.492630:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789061729.492660:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789061729.492699:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789061729.492734:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789061729.492764:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789061729.492807:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789061729.492837:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789061729.492866:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789061729.492905:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789061729.492934:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789061729.492963:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789061729.493004:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789061729.493034:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789061729.493063:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789061729.493124:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789061729.493168:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789061729.493198:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789061729.493249:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789061729.493301:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789061729.493336:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789061729.493385:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789061729.493422:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789061729.493454:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789061729.493513:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789061729.493561:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789061729.493609:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789061729.493670:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789061729.493706:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789061729.495819:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789061729.495839:0:15694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789061729.495965:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789061729.496711:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.498826:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061729.503430:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779559552 00000100:00100000:2.0:1789061729.503446:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779559552 00000100:00100000:2.0:1789061729.503526:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789061729.503537:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:15694:x1875966779559552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789061729.503961:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:15694:x1875966779559552:12345-0@lo:501:mount.lustre.0 Request processed in 424us (7250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061729.503971:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789061729.506837:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789061729.506900:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789061729.506968:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.507013:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26600 going to sleep for 11 seconds 00000100:00100000:0.0:1789061729.507341:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779559680 00000100:00100000:0.0:1789061729.507349:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779559680 00000100:00100000:0.0:1789061729.507406:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789061729.507416:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:15694:x1875966779559680:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789061729.507824:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:15694:x1875966779559680:12345-0@lo:503:mount.lustre.0 Request processed in 409us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061729.507833:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789061729.513193:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559680:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789061729.514030:0:15694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789061729.514130:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789061729.514203:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.514249:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26600 going to sleep for 11 seconds 00000100:00100000:0.0:1789061729.514410:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779559808 00000100:00100000:0.0:1789061729.514417:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779559808 00000100:00100000:0.0:1789061729.514464:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789061729.514474:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:15694:x1875966779559808:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789061729.514790:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:15694:x1875966779559808:12345-0@lo:502:mount.lustre.0 Request processed in 317us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061729.514799:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789061729.518042:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789061729.518413:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789061729.518474:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789061729.518530:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789061729.518575:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789061729.519767:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789061729.519842:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789061729.519882:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789061729.519915:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789061729.519966:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789061729.520015:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789061729.520044:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789061729.520093:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789061729.520135:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789061729.520177:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789061729.520247:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789061729.520334:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789061729.520383:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789061729.520437:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789061729.520477:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789061729.520539:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789061729.522717:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789061729.522812:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789061729.522842:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789061729.522896:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789061729.522927:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789061729.522956:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789061729.522995:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789061729.523025:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789061729.523053:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789061729.523094:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789061729.523135:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789061729.523190:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789061729.523233:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789061729.523317:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789061729.523361:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789061729.523405:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789061729.523446:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789061729.523519:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789061729.525888:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789061729.526730:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789061729.527280:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789061729.527375:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061729.527464:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64f26600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061729.530391:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779559936 00000100:00100000:2.0:1789061729.530407:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779559936 00000100:00100000:2.0:1789061729.530765:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789061729.530779:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:15694:x1875966779559936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789061729.532146:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:15694:x1875966779559936:12345-0@lo:502:mount.lustre.0 Request processed in 1367us (4766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061729.532224:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779559936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789061729.532366:0:15694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789061729.532381:0:15694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000100:00100000:2.0:1789061729.535615:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000020:01000004:0.0:1789061729.539094:0:15703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789061729.539112:0:15703:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff971945050000) 00000020:00000080:0.0:1789061729.539137:0:15703:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789061729.539230:0:15703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97194505f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789061729.539234:0:15703:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97194505f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789061729.539237:0:15703:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97194505f000 3 00010000:00080000:0.0:1789061729.539282:0:15703:0:(ldlm_lib.c:102:import_set_conn()) imp ffff971946e66800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1789061729.552184:0:15703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1789061729.552416:0:15703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789061729.552458:0:15703:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789061729.552470:0:15703:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x427fa11dc4a9b9e5 00000100:00080000:1.0:1789061729.552482:0:15703:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789061729.552514:0:15703:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff971946e66800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789061729.552552:0:15703:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9719453e7100 x1875966779560064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789061729.553339:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875966779560064:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789061729.553408:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061729.554744:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779560064 00000100:00100000:3.0:1789061729.554756:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779560064 00000100:00100000:3.0:1789061729.554809:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061729.554817:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875966779560064:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789061729.554845:0:14291:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:3.0:1789061729.554879:0:14291:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x427fa11dc4a9b9ec 00000004:00100000:3.0:1789061729.554897:0:14291:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789061729.554932:0:14291:0:(import.c:65:import_set_state_nolock()) ffff97194505c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061729.555014:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875966779560064:12345-0@lo:38:llog_process_th.0 Request processed in 195us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061729.555022:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789061729.555074:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9719453e7100 x1875966779560064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789061739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061729.555086:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789061729.555095:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789061729.555104:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789061729.555108:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789061729.555111:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971946e66800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789061729.555117:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875966779560064:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789061729.556222:0:15703:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1789061729.559060:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789061729.559443:0:15694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789061729.559473:0:15694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789061729.559522:0:15694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c524200/0x427fa11dc4a9b9d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b9d7 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.559549:0:15694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7c524200/0x427fa11dc4a9b9d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9b9d7 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789061729.559622:0:15694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789061729.559625:0:15694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789061729.559626:0:15694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789061729.559628:0:15694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789061729.559629:0:15694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789061729.559630:0:15694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789061729.559632:0:15694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789061729.559633:0:15694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789061729.559635:0:15694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789061729.559639:0:15694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789061729.559642:0:15694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789061729.559643:0:15694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789061729.559644:0:15694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789061729.559645:0:15694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789061729.559646:0:15694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789061729.559647:0:15694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789061729.559648:0:15694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789061729.559649:0:15694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789061729.559650:0:15694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789061729.559679:0:15694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789061729.559702:0:15694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779560192:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789061729.559791:0:15694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061729.559833:0:15694:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d700c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789061729.559857:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779560192 00000100:00100000:3.0:1789061729.559865:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779560192 00000100:00100000:3.0:1789061729.559914:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789061729.559923:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:15694:x1875966779560192:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789061729.559951:0:14284:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789061729.559968:0:14284:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789061729.600339:0:14284:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789061729.600359:0:14284:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789061729.602157:0:14307:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789061729.602171:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789061729.602210:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061729.602230:0:14307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7596ca00/0x427fa11dc4a9b8c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b8bf expref: 19 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061729.602239:0:14307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061729.602297:0:14307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7596ca00/0x427fa11dc4a9b8c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9b8bf expref: 19 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061729.602314:0:14307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a7596ca00/0x427fa11dc4a9b8c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9b8bf expref: 19 pid: 14284 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061729.602329:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14307:1875966779560320:0@lo:104: 00000100:00100000:0.0:1789061729.602394:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061729.602437:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4d436480 going to sleep for 11 seconds 00000100:00100000:3.0:1789061729.602578:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779560320 00000100:00100000:3.0:1789061729.602647:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779560320 00000100:00100000:3.0:1789061729.602741:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061729.602751:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d02fbc9-0efc-41a2-bf6f-922e38501192+3:14307:x1875966779560320:12345-0@lo:104: 00010000:00010000:3.0:1789061729.602767:0:14275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b8c6 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.602825:0:14275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789061729.602832:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d02fbc9-0efc-41a2-bf6f-922e38501192+3:14307:x1875966779560320:12345-0@lo:104: Request processed in 84us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061729.602839:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789061729.604668:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14307:1875966779560320:0@lo:104: 00010000:00010000:0.0:1789061729.604699:0:14307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061729.605710:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:15694:x1875966779560192:12345-0@lo:253:mount.lustre.0 Request processed in 45780us (45911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061729.605726:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789061729.605870:0:15694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d02fbc9-0efc-41a2-bf6f-922e38501192:15694:1875966779560192:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789061729.605884:0:15694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789061729.605887:0:15694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789061729.605888:0:15694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789061729.605890:0:15694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061729.605891:0:15694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061729.605892:0:15694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061729.605894:0:15694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061729.605895:0:15694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061729.605897:0:15694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061729.605898:0:15694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789061729.605912:0:15694:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789061729.607410:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061729.607426:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b8c6 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.607439:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042e00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1789061729.607444:0:14279:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9b8c6 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.607455:0:14279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9b8c6 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061729.607463:0:14279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9b8c6 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061729.607470:0:14279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789061729.607632:0:14279:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b8c6 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.607661:0:14279:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061729.607685:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b8c6 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.607692:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a82042e00/0x427fa11dc4a9b8bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b8c6 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.607710:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061729.607712:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061729.607714:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061729.607731:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779560448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061729.607791:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061729.607848:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779560448 00000100:00100000:3.0:1789061729.607855:0:14276:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779560448 00010000:00010000:3.0:1789061729.607897:0:14276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7596ca00/0x427fa11dc4a9b8c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b8bf expref: 19 pid: 14284 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061729.607930:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061729.607940:0:14276:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:3310:x1875966779560448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789061729.607960:0:14276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061729.607965:0:14276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7596ca00/0x427fa11dc4a9b8c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b8bf expref: 19 pid: 14284 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.607977:0:14276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7596ca00/0x427fa11dc4a9b8c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9b8bf expref: 19 pid: 14284 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.607993:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7596ca00/0x427fa11dc4a9b8c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9b8bf expref: 19 pid: 14284 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.608018:0:14276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.608027:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789061729.608042:0:14276:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008011720s 00010000:00010000:3.0:1789061729.608047:0:14276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.608054:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.608062:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.608069:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.608074:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c000 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061729.608079:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.608087:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.608100:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.608110:0:14276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061729.608145:0:14276:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:3310:x1875966779560448:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061729.608152:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061729.608189:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779560448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789061729.608210:0:14307:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.608218:0:14307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061729.608226:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9b9f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789061729.611901:0:15694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789061729.612066:0:15694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789061729.612221:0:15694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789061729.612385:0:15694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789061729.612577:0:15694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789061729.612802:0:15694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789061729.614859:0:15694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1789061729.663197:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789061729.685653:0:15694:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789061729.685664:0:15694:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789061729.685701:0:15694:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789061729.685767:0:15694:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789061729.685784:0:15694:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789061729.685815:0:15694:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789061730.699435:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789061731.019270:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789061731.262900:0:14288:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789061731.262911:0:14288:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97194517e000 from 8 10000000:01000000:1.0:1789061731.262917:0:14288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789061731.262970:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c525c00/0x427fa11dc4a9b9fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061731.262984:0:14288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7c525c00/0x427fa11dc4a9b9fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061731.262995:0:14288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7c525c00/0x427fa11dc4a9b9fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061731.263022:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779560576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789061731.263096:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061731.263147:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4ea02600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061731.263337:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779560576 00000100:00100000:2.0:1789061731.263344:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779560576 00000100:00100000:2.0:1789061731.263398:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789061731.263407:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:14288:x1875966779560576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061731.263421:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061731.263435:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9ba01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9b9fa expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061731.263459:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9ba01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9b9fa expref: 19 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061731.263469:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a4f63e200/0x427fa11dc4a9ba01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b9fa expref: 19 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061731.263477:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63e200, rc 0) 00000100:00100000:2.0:1789061731.263541:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945c97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:14288:x1875966779560576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061731.263558:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789061731.263839:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779560576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061731.263864:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7c525c00/0x427fa11dc4a9b9fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9ba01 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061731.263875:0:14288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7c525c00/0x427fa11dc4a9b9fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9ba01 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061731.263928:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779560704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789061731.263976:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061731.264001:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4ea02600 going to sleep for 11 seconds 00000100:00100000:1.0:1789061731.264016:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779560704 00000100:00100000:1.0:1789061731.264020:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779560704 00000100:00100000:1.0:1789061731.264046:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789061731.264052:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a753ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:14288:x1875966779560704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789061731.264067:0:14284:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789061731.264085:0:14284:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789061731.264088:0:14284:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789061731.264165:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a753ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:14288:x1875966779560704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061731.264172:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789061731.264204:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779560704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789061731.264271:0:14288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789061731.264279:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c525c00/0x427fa11dc4a9b9fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9ba01 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061731.264289:0:14288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7c525c00/0x427fa11dc4a9b9fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9ba01 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061731.718180:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061732.733756:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061733.757806:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061734.144821:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061734.144846:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779560832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061734.145059:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061734.145130:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779560832 00000100:00100000:3.0:1789061734.145140:0:14978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779560832 00000100:00080000:1.0:1789061734.145227:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061734.145282:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789061734.145293:0:14978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779560832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789061734.145329:0:14978:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789061734.145378:0:14978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779560832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061734.145636:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789061734.145923:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779560832:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789061734.653758:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789061734.653766:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789061734.653770:0:36:0:(import.c:65:import_set_state_nolock()) ffff971946bc9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789061734.653789:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:0.0:1789061734.653793:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789061734.653805:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff971946bc9800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789061734.653832:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff971947e4a680 x1875966779561088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789061734.653891:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d02fbc9-0efc-41a2-bf6f-922e38501192:3312:1875966779560960:0@lo:400:kworker.0 00000100:00100000:0.0:1789061734.653957:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061734.654012:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789061734.654019:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779561216:0@lo:400:kworker.0 00000100:00100000:0.0:1789061734.654045:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061734.654074:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779561472:0@lo:400:kworker.0 00000100:00100000:0.0:1789061734.654099:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061734.654115:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061734.654120:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779561344:0@lo:400:kworker.0 00000100:00100000:0.0:1789061734.654144:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061734.654181:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779560960 00000100:00100000:0.0:1789061734.654188:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779560960 00000100:00100000:3.0:1789061734.654356:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779561088:0@lo:8:kworker.0 00000100:00100000:3.0:1789061734.654395:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061734.654442:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779561216 00000100:00100000:3.0:1789061734.654446:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779561216 00000100:00100000:3.0:1789061734.654468:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779561472 00000100:00100000:3.0:1789061734.654471:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779561472 00000100:00100000:3.0:1789061734.654522:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779561344 00000100:00100000:3.0:1789061734.654526:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779561344 00000100:00100000:3.0:1789061734.654542:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789061734.654550:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779561216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061734.654603:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779561216:12345-0@lo:400:kworker.0 Request processed in 53us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061734.654610:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789061734.654626:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789061734.654633:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779561472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061734.654665:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779561472:12345-0@lo:400:kworker.0 Request processed in 33us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061734.654671:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789061734.654683:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789061734.654689:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779561344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061734.654716:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875966779561344:12345-0@lo:400:kworker.0 Request processed in 28us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061734.654721:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789061734.654763:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779561088 00000100:00100000:3.0:1789061734.654768:0:14975:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779561088 00000100:00100000:3.0:1789061734.654785:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789061734.654789:0:14975:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1875966779561088:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789061734.654811:0:14975:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:3.0:1789061734.654846:0:14975:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x427fa11dc4a9ba08 00002000:00100000:3.0:1789061734.654859:0:14975:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff971a4d6d9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789061734.654863:0:14975:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789061734.654866:0:14975:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789061734.655207:0:14975:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789061734.655242:0:14975:0:(import.c:65:import_set_state_nolock()) ffff971a4d6d8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061734.655282:0:14975:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875966779561088:12345-0@lo:8:kworker.0 Request processed in 491us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061734.655289:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789061734.655307:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789061734.655570:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971947e4a680 x1875966779561088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789061759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061734.655581:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789061734.655589:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789061734.655596:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789061734.655601:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789061734.655604:0:3309:0:(import.c:65:import_set_state_nolock()) ffff971946bc9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789061734.655620:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789061734.655625:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875966779561088:0@lo:8:kworker.0 00000004:00080000:3.0:1789061734.655687:0:14316:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1789061734.655706:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14316:1875966779561728:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789061734.655733:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061734.655752:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47daccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061734.655771:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779561728 00000100:00100000:3.0:1789061734.655775:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779561728 00000100:00100000:3.0:1789061734.655806:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789061734.655812:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14316:x1875966779561728:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789061734.657786:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789061734.657806:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a753ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:3312:x1875966779560960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061734.657881:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a753ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:3312:x1875966779560960:12345-0@lo:400:kworker.0 Request processed in 83us (3923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061734.657888:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:0.0:1789061734.657941:0:14315:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789061734.658360:0:14315:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 508899871492ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789061734.665667:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061734.665699:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779561600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061734.665776:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789061734.665820:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789061734.665857:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971947e49f80 x1875966779561344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061734.665873:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875966779561344:0@lo:400:kworker.0 00010000:00080000:3.0:1789061734.665886:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971947e4bb80 x1875966779561472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061734.665895:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779561472:0@lo:400:kworker.0 00010000:00080000:3.0:1789061734.665930:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971947e4b480 x1875966779561216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061734.665939:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779561216:0@lo:400:kworker.0 00000100:00100000:3.0:1789061734.665948:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d02fbc9-0efc-41a2-bf6f-922e38501192:3312:1875966779560960:0@lo:400:kworker.0 00000100:00100000:1.0:1789061734.666944:0:14979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779561600 00000100:00100000:1.0:1789061734.666954:0:14979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779561600 00000100:00100000:1.0:1789061734.666999:0:14979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789061734.667009:0:14979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875966779561600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061734.667041:0:14979:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061734.667582:0:14979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875966779561600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 574us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061734.667591:0:14979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00080000:2.0:1789061734.671412:0:14977:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789061734.671436:0:14977:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789061734.671444:0:14977:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00010000:00080000:0.0:1789061734.676131:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff971946bd2a00 x1875966779561600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061734.676192:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779561600:0@lo:13:osp-pre-1-0.0 00002000:00010000:2.0:1789061734.685286:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.685301:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.685319:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.685323:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.685329:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.685348:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.685359:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.685366:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.685387:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789061734.686087:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.686096:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686106:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.686110:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.686122:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686134:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686142:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686148:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686166:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789061734.686192:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789061734.686198:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686206:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061734.686210:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686219:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686236:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686255:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686273:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061734.686276:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686282:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061734.686285:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686293:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686304:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686310:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686322:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.686324:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.686326:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.686780:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.686787:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686803:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.686807:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.686811:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686821:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686829:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686836:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686851:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061734.686860:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061734.686865:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686872:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ec00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061734.686876:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686883:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686908:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686916:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.686931:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.686933:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.686935:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.687351:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.687358:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.687366:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.687369:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.687373:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.687382:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.687391:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.687400:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.687433:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789061734.687980:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061734.687988:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.687998:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ea00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061734.688002:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.688011:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.688047:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba24 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.688054:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.688073:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061734.688075:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061734.688076:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.689788:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.689798:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.689814:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.689819:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.689825:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.689885:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.689896:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.689905:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.689922:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061734.689934:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061734.689940:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.689948:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fc00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061734.689961:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.689971:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.690060:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.690069:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.690086:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.690088:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.690090:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061734.690769:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.691605:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.691615:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.691630:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.691634:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.691640:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.691651:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.691659:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.691673:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.691814:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789061734.692326:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.692332:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.692342:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.692345:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.692349:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.692358:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.692366:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.692379:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.694141:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789061734.694158:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.694184:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fa00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061734.694189:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.694199:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.694226:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.694233:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.694263:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061734.694267:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.694272:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061734.694275:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.694298:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.694308:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.694317:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061734.694319:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061734.694321:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.694482:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789061734.694511:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789061734.696272:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.696287:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.696303:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.696308:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.696313:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.696327:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.696336:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.696344:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.696949:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061734.696959:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.696969:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061734.696974:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.696984:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.697110:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.697244:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061734.697246:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061734.697248:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.698790:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789061734.698802:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.698931:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.703793:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.703818:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.704115:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.704121:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.704128:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.704147:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.704161:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.704306:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.704337:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789061734.704803:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061734.704812:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.704822:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fc00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061734.704827:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.704848:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.704870:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.704879:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaa32e3b/0x427fa11dc4a9ba47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061734.704907:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061734.704910:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061734.704913:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.705638:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.705647:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.705659:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.705664:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.705669:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.707126:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.707158:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.707165:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.708472:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789061734.708681:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061734.708691:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.708704:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ec00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061734.708710:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.708720:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.708743:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.708752:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bee15664/0x427fa11dc4a9ba4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.708789:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061734.708791:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061734.708793:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789061734.709359:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789061734.709609:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.709619:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.709634:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.709639:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.709647:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.709661:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.709670:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.709677:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.709716:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061734.709726:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061734.709731:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.709738:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061734.709742:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.709752:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.709766:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.709774:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096e6a65e/0x427fa11dc4a9ba55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.709789:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.709790:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.709792:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.710312:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.710318:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.710328:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.710337:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.710342:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.710352:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.710361:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.710368:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.710392:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789061734.710419:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061734.710427:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.710436:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061734.710441:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.710449:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.710463:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.710471:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000338640e8/0x427fa11dc4a9ba5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.710518:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061734.710521:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061734.710524:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.710850:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.710856:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0a3169b/0x427fa11dc4a9ba63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.710865:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.710868:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.710872:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0a3169b/0x427fa11dc4a9ba63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.710882:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0a3169b/0x427fa11dc4a9ba63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.710891:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0a3169b/0x427fa11dc4a9ba63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.710904:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0a3169b/0x427fa11dc4a9ba63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.710925:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789061734.711381:0:14280:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061734.711387:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0a3169b/0x427fa11dc4a9ba63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.711406:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061734.711410:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0a3169b/0x427fa11dc4a9ba63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.711419:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0a3169b/0x427fa11dc4a9ba63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.711433:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0a3169b/0x427fa11dc4a9ba63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.711440:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0a3169b/0x427fa11dc4a9ba63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061734.711458:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061734.711460:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061734.711462:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.712769:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.712779:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ba6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.712794:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.712798:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.712804:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ba6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.712817:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ba6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.712826:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ba6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.712834:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ba6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.712853:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061734.712865:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061734.712871:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ba6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.712886:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061734.712891:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ba6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.712901:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ba6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.712916:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ba6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.712924:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075702816/0x427fa11dc4a9ba6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.712941:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.712943:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.712945:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.713825:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.713833:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.713845:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.713849:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.713858:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.713870:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.713887:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.713894:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.713918:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789061734.714365:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.714371:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.714379:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.714383:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.714386:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.714395:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.714402:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.714409:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.714445:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789061734.714923:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.714929:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9ba7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.714938:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.714941:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.714946:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9ba7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.714955:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9ba7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.714964:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9ba7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.714971:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9ba7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.714986:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789061734.714997:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789061734.715003:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715010:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fa00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061734.715021:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715031:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715047:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715054:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9ba71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715071:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789061734.715074:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715080:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ea00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061734.715083:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715091:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715101:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715109:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aadf1e70/0x427fa11dc4a9ba78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715130:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061734.715133:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9ba7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715140:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476000 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061734.715143:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9ba7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715150:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9ba7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715162:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9ba7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715176:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9ba7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715189:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.715191:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.715193:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.715626:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.715632:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9ba86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715641:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.715650:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.715654:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9ba86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715664:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9ba86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715672:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9ba86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715679:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9ba86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715692:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061734.715701:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061734.715704:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9ba86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715711:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41477e00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061734.715715:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9ba86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715721:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9ba86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715732:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9ba86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715749:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9ba86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.715764:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.715766:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.715767:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.716186:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.716193:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006110bf17/0x427fa11dc4a9ba8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.716201:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.716204:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.716208:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006110bf17/0x427fa11dc4a9ba8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.716216:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006110bf17/0x427fa11dc4a9ba8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.716225:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006110bf17/0x427fa11dc4a9ba8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.716231:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006110bf17/0x427fa11dc4a9ba8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.716245:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061734.716252:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061734.716262:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006110bf17/0x427fa11dc4a9ba8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.716269:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41477800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061734.716273:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006110bf17/0x427fa11dc4a9ba8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.716281:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006110bf17/0x427fa11dc4a9ba8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.716292:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006110bf17/0x427fa11dc4a9ba8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.716300:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006110bf17/0x427fa11dc4a9ba8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.716314:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.716315:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.716317:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061734.716555:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061734.716824:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.717330:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.717338:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1645e89/0x427fa11dc4a9ba94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.717349:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.717353:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.717357:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1645e89/0x427fa11dc4a9ba94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.717380:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1645e89/0x427fa11dc4a9ba94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.717389:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1645e89/0x427fa11dc4a9ba94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.717397:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1645e89/0x427fa11dc4a9ba94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.718409:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789061734.719246:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061734.719256:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1645e89/0x427fa11dc4a9ba94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.719268:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476a00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061734.719273:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1645e89/0x427fa11dc4a9ba94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.719283:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1645e89/0x427fa11dc4a9ba94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.719305:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1645e89/0x427fa11dc4a9ba94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.719312:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1645e89/0x427fa11dc4a9ba94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.719345:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061734.719347:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061734.719349:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.719789:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.719798:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8ae9934/0x427fa11dc4a9ba9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.719810:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.719814:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.719819:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8ae9934/0x427fa11dc4a9ba9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.719829:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8ae9934/0x427fa11dc4a9ba9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.719838:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8ae9934/0x427fa11dc4a9ba9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.719862:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8ae9934/0x427fa11dc4a9ba9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.720376:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789061734.720968:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.720975:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ac009c/0x427fa11dc4a9baa2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.721112:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.721117:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.721122:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ac009c/0x427fa11dc4a9baa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.721136:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2ac009c/0x427fa11dc4a9baa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.721145:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ac009c/0x427fa11dc4a9baa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.721153:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ac009c/0x427fa11dc4a9baa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.721247:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789061734.721256:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8ae9934/0x427fa11dc4a9ba9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.721264:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061734.721268:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8ae9934/0x427fa11dc4a9ba9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.721279:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8ae9934/0x427fa11dc4a9ba9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.721296:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8ae9934/0x427fa11dc4a9ba9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.721303:0:14279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8ae9934/0x427fa11dc4a9ba9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.721320:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061734.721324:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2ac009c/0x427fa11dc4a9baa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.721330:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41477400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061734.721341:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ac009c/0x427fa11dc4a9baa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.721349:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ac009c/0x427fa11dc4a9baa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.721360:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2ac009c/0x427fa11dc4a9baa2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.721368:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061734.721370:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061734.721372:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.721441:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789061734.721447:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2ac009c/0x427fa11dc4a9baa2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.722095:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.722382:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.722389:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036253f4a/0x427fa11dc4a9baa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.722400:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.722404:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.722408:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036253f4a/0x427fa11dc4a9baa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.722418:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036253f4a/0x427fa11dc4a9baa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.722426:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036253f4a/0x427fa11dc4a9baa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.722433:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036253f4a/0x427fa11dc4a9baa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.722516:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789061734.722969:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.722975:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dde765ee/0x427fa11dc4a9bab0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.722983:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.723002:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.723015:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dde765ee/0x427fa11dc4a9bab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.723026:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dde765ee/0x427fa11dc4a9bab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.723035:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dde765ee/0x427fa11dc4a9bab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.723042:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dde765ee/0x427fa11dc4a9bab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.725939:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789061734.725953:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036253f4a/0x427fa11dc4a9baa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.725967:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41477200 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061734.725972:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036253f4a/0x427fa11dc4a9baa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.725983:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036253f4a/0x427fa11dc4a9baa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.726013:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036253f4a/0x427fa11dc4a9baa9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.726021:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036253f4a/0x427fa11dc4a9baa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.726049:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061734.726053:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dde765ee/0x427fa11dc4a9bab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.726060:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061734.726063:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dde765ee/0x427fa11dc4a9bab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.726070:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dde765ee/0x427fa11dc4a9bab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.726078:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dde765ee/0x427fa11dc4a9bab0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.726084:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061734.726086:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061734.726088:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.729448:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789061734.729464:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dde765ee/0x427fa11dc4a9bab0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789061734.730228:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.730238:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a051b79/0x427fa11dc4a9bab7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.730254:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.730259:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.730266:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a051b79/0x427fa11dc4a9bab7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.730281:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a051b79/0x427fa11dc4a9bab7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.730304:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a051b79/0x427fa11dc4a9bab7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.730311:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a051b79/0x427fa11dc4a9bab7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.733351:0:14279:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061734.733367:0:14279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a051b79/0x427fa11dc4a9bab7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.733380:0:14279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476c00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061734.733386:0:14279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a051b79/0x427fa11dc4a9bab7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.733409:0:14279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a051b79/0x427fa11dc4a9bab7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.733431:0:14279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a051b79/0x427fa11dc4a9bab7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.733442:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061734.733444:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061734.733446:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.737210:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789061734.737230:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a051b79/0x427fa11dc4a9bab7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.737276:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789061734.737982:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.739160:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ef4ab6/0x427fa11dc4a9babe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.739190:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.739196:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.739203:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ef4ab6/0x427fa11dc4a9babe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.739219:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ef4ab6/0x427fa11dc4a9babe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.739230:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ef4ab6/0x427fa11dc4a9babe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.739253:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082ef4ab6/0x427fa11dc4a9babe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.741427:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789061734.742107:0:14977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789061734.742117:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbfa18ef/0x427fa11dc4a9bac5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.742137:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1789061734.742142:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061734.742150:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfa18ef/0x427fa11dc4a9bac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.742165:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbfa18ef/0x427fa11dc4a9bac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.742190:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbfa18ef/0x427fa11dc4a9bac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061734.742199:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfa18ef/0x427fa11dc4a9bac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.742693:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789061734.742703:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082ef4ab6/0x427fa11dc4a9babe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.742712:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944647a00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061734.742717:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ef4ab6/0x427fa11dc4a9babe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.742728:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ef4ab6/0x427fa11dc4a9babe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.742748:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082ef4ab6/0x427fa11dc4a9babe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.742756:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ef4ab6/0x427fa11dc4a9babe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.742806:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061734.742810:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbfa18ef/0x427fa11dc4a9bac5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.742816:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944647600 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061734.742820:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbfa18ef/0x427fa11dc4a9bac5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.742827:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbfa18ef/0x427fa11dc4a9bac5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.742838:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbfa18ef/0x427fa11dc4a9bac5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061734.742846:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061734.742847:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061734.742849:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061734.748763:0:14977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789061734.748787:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbfa18ef/0x427fa11dc4a9bac5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789061734.749358:0:14977:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1789061734.750411:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14316:x1875966779561728:12345-0@lo:5:osp-pre-1-0.0 Request processed in 94589us (94668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061734.750425:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789061734.751785:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061734.756411:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14316:1875966779561728:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789061734.756437:0:14316:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789061734.756521:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14316:1875966779561856:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789061734.756580:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061734.756634:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64d0b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061734.761124:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779561856 00000100:00100000:0.0:1789061734.761141:0:14976:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779561856 00000100:00100000:0.0:1789061734.761220:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061734.761231:0:14976:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14316:x1875966779561856:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789061734.761284:0:14976:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1789061734.773439:0:14976:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14316:x1875966779561856:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12203us (16851us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789061734.773452:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789061734.776778:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14316:1875966779561856:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789061734.776802:0:14316:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1789061734.782908:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061735.806853:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789061736.449185:0:16048:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789061736.836698:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061737.853703:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061738.759423:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061738.759730:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758592640 00000100:00100000:1.0:1789061738.759797:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758592640 00000100:00100000:1.0:1789061738.759853:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:1.0:1789061738.759863:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a753ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1875966758592640:12345-192.168.204.54@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789061738.759896:0:14283:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 282d5b89-cba7-4159-9b75-d113061ec0de@192.168.204.54@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1789061738.760186:0:14283:0:(genops.c:1384:class_connect()) connect: client 282d5b89-cba7-4159-9b75-d113061ec0de, cookie 0x427fa11dc4a9bacc 00000100:00080000:1.0:1789061738.761191:0:14283:0:(import.c:65:import_set_state_nolock()) ffff97194756a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061738.761444:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a753ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+5:2352:x1875966758592640:12345-192.168.204.54@tcp:250:mount.lustre.0 Request processed in 1579us (2150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061738.761456:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:2.0:1789061738.773618:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061738.773746:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758592768 00000100:00100000:0.0:1789061738.773759:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758592768 00000100:00100000:0.0:1789061738.773815:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:0.0:1789061738.773825:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a753ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+5:13733:x1875966758592768:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789061738.773841:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061738.773858:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596c200/0x427fa11dc4a9bad3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a3f0 expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061738.773885:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596c200/0x427fa11dc4a9bad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3f0 expref: 6 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061738.773898:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596c200/0x427fa11dc4a9bad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3f0 expref: 6 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061738.773908:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c200, rc 0) 00000100:00100000:0.0:1789061738.773969:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a753ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+6:13733:x1875966758592768:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 146us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061738.773977:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1789061738.780451:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061738.780688:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758592896 00000100:00100000:1.0:1789061738.780698:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758592896 00000100:00100000:1.0:1789061738.780824:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:1.0:1789061738.780835:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a753efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+6:13733:x1875966758592896:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789061738.781159:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a753efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+6:13733:x1875966758592896:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 325us (716us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789061738.781168:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:2.0:1789061738.784220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061738.784274:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758593024 00000100:00100000:0.0:1789061738.784297:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758593024 00000100:00100000:0.0:1789061738.784354:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:0.0:1789061738.784364:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a753ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+6:13733:x1875966758593024:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789061738.784389:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061738.784408:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596c400/0x427fa11dc4a9bada lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a3f7 expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061738.784436:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596c400/0x427fa11dc4a9bada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3f7 expref: 7 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061738.784462:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596c400/0x427fa11dc4a9bada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a3f7 expref: 7 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061738.784471:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c400, rc 0) 00000100:00100000:0.0:1789061738.784569:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a753ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+7:13733:x1875966758593024:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 205us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061738.784576:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:0.0:1789061738.786386:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061738.787408:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758593152 00000100:00100000:1.0:1789061738.787419:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758593152 00000100:00100000:1.0:1789061738.787479:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:1.0:1789061738.787505:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+7:13733:x1875966758593152:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789061738.787773:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+8:13733:x1875966758593152:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 284us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061738.787781:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:3.0:1789061738.789468:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061738.791147:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758593280 00000100:00100000:2.0:1789061738.791162:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758593280 00000100:00100000:2.0:1789061738.791245:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:2.0:1789061738.791255:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+8:13733:x1875966758593280:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789061738.791709:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+8:13733:x1875966758593280:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 453us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061738.791718:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:2.0:1789061738.795338:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061738.795793:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758593408 00000100:00100000:0.0:1789061738.795809:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758593408 00000100:00100000:0.0:1789061738.795880:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:0.0:1789061738.795891:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+8:13752:x1875966758593408:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789061738.797084:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+8:13752:x1875966758593408:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 1187us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061738.797105:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:0.0:1789061738.833641:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061738.834152:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758593536 00000100:00100000:1.0:1789061738.834167:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758593536 00000100:00100000:1.0:1789061738.834250:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:1.0:1789061738.834261:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+8:13752:x1875966758593536:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789061738.834611:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+8:13752:x1875966758593536:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 351us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061738.834620:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:3.0:1789061738.840328:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061738.841540:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758593664 00000100:00100000:2.0:1789061738.841557:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758593664 00000100:00100000:2.0:1789061738.841643:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1789061738.841656:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+8:13733:x1875966758593664:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789061738.841677:0:14286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061738.841702:0:14286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971944647e00/0x427fa11dc4a9bae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a421 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061738.841740:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971944647e00/0x427fa11dc4a9bae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a421 expref: 9 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061738.841784:0:14286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971944647e00/0x427fa11dc4a9bae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a421 expref: 9 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061738.841796:0:14286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971944647e00, rc 0) 00000100:00100000:2.0:1789061738.841880:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+9:13733:x1875966758593664:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 227us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061738.841887:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1789061738.849677:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061738.849839:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758593792 00000100:00100000:1.0:1789061738.849854:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758593792 00000100:00100000:1.0:1789061738.849998:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:1.0:1789061738.850013:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+9:13733:x1875966758593792:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789061738.850050:0:14284:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789061738.850084:0:14284:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789061738.850089:0:14284:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789061738.850103:0:14284:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789061738.850106:0:14284:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789061738.855786:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+9:13733:x1875966758593792:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 5763us (6110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061738.855803:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:3.0:1789061738.861758:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061738.862041:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758593920 00000100:00100000:2.0:1789061738.862056:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758593920 00000100:00100000:2.0:1789061738.862143:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:2.0:1789061738.862153:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+9:13733:x1875966758593920:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789061738.862170:0:14286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061738.862191:0:14286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971944646400/0x427fa11dc4a9bae8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a428 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061738.862222:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971944646400/0x427fa11dc4a9bae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a428 expref: 10 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061738.862234:0:14286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971944646400/0x427fa11dc4a9bae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a428 expref: 10 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061738.862242:0:14286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971944646400, rc 0) 00000100:00100000:2.0:1789061738.862555:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+10:13733:x1875966758593920:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 402us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061738.862562:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:2.0:1789061738.865651:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061738.865907:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758594048 00000100:00100000:1.0:1789061738.865922:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758594048 00000100:00100000:1.0:1789061738.866005:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:1.0:1789061738.866019:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+10:13733:x1875966758594048:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789061738.867251:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+10:13733:x1875966758594048:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 1231us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061738.867264:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:0.0:1789061738.869592:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061738.869695:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758594176 00000100:00100000:2.0:1789061738.869714:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758594176 00000100:00100000:2.0:1789061738.869793:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:2.0:1789061738.869806:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+10:13733:x1875966758594176:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789061738.871615:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+10:13733:x1875966758594176:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 1789us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061738.871633:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00010000:00010000:3.0:1789061738.879069:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061738.884735:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061738.885551:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758594304 00000100:00100000:1.0:1789061738.885563:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758594304 00000100:00100000:1.0:1789061738.885631:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:1.0:1789061738.885642:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+10:13755:x1875966758594304:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789061738.886015:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+10:13755:x1875966758594304:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 373us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061738.886023:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:1.0:1789061738.894230:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061738.894390:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758594432 00000100:00100000:2.0:1789061738.894402:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758594432 00000100:00100000:2.0:1789061738.894469:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:2.0:1789061738.894479:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+10:13755:x1875966758594432:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789061738.894778:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+10:13755:x1875966758594432:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 300us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061738.894786:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:0.0:1789061738.898767:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061738.898994:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758594560 00000100:00100000:3.0:1789061738.899010:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758594560 00000100:00100000:3.0:1789061738.899079:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1789061738.899100:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1875966758594560:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789061738.899279:0:14292:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c851c516-4d06-4311-8aaf-200a057f0d40@192.168.204.54@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:3.0:1789061738.899347:0:14292:0:(genops.c:1384:class_connect()) connect: client c851c516-4d06-4311-8aaf-200a057f0d40, cookie 0x427fa11dc4a9baef 00000004:00100000:3.0:1789061738.899392:0:14292:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789061738.899399:0:14292:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789061738.945871:0:14292:0:(import.c:65:import_set_state_nolock()) ffff971945e19000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789061738.946112:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+6:2352:x1875966758594560:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 47020us (47359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061738.946126:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1789061738.951302:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061738.951582:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061738.952127:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758594688 00000100:00100000:0.0:1789061738.952200:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758594688 00000100:00100000:0.0:1789061738.952342:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758594816 00000100:00100000:0.0:1789061738.952346:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758594816 00000100:00100000:0.0:1789061738.952369:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1789061738.952383:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+7:0:x1875966758594688:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789061738.952464:0:14293:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789061738.952627:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+7:0:x1875966758594688:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 245us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061738.952634:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1789061738.952658:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1789061738.952665:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+6:13733:x1875966758594816:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789061738.952677:0:14293:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789061738.952702:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+6:13733:x1875966758594816:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 38us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061738.952708:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00080000:1.0:1789061738.955527:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061738.956547:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061738.956695:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758594944 00000100:00100000:0.0:1789061738.956709:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758594944 00000100:00100000:0.0:1789061738.956788:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789061738.956802:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+6:13733:x1875966758594944:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789061738.957077:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+6:13733:x1875966758594944:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 278us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061738.957087:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789061738.961422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061738.961467:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061738.961558:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061738.961648:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758595072 00000100:00100000:1.0:1789061738.961662:0:14975:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758595072 00000100:00100000:1.0:1789061738.961714:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758595200 00000100:00100000:1.0:1789061738.961717:0:14975:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758595200 00000100:00100000:1.0:1789061738.961734:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:1.0:1789061738.961746:0:14975:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875966758595072:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789061738.961787:0:14975:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c851c516-4d06-4311-8aaf-200a057f0d40@192.168.204.54@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1789061738.961840:0:14975:0:(genops.c:1384:class_connect()) connect: client c851c516-4d06-4311-8aaf-200a057f0d40, cookie 0x427fa11dc4a9baf6 00002000:00100000:1.0:1789061738.961854:0:14975:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c851c516-4d06-4311-8aaf-200a057f0d40/ffff97194756d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789061738.961888:0:14975:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789061738.962330:0:14975:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789061738.962378:0:14975:0:(import.c:65:import_set_state_nolock()) ffff97194756d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061738.962480:0:14975:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c851c516-4d06-4311-8aaf-200a057f0d40+6:2352:x1875966758595072:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 735us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061738.962547:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:1.0:1789061738.962577:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1789061738.962583:0:14975:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875966758595200:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789061738.962604:0:14975:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c851c516-4d06-4311-8aaf-200a057f0d40@192.168.204.54@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1789061738.962623:0:14975:0:(genops.c:1384:class_connect()) connect: client c851c516-4d06-4311-8aaf-200a057f0d40, cookie 0x427fa11dc4a9bafd 00002000:00100000:1.0:1789061738.962631:0:14975:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c851c516-4d06-4311-8aaf-200a057f0d40/ffff97194756c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789061738.962649:0:14975:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789061738.962784:0:14975:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789061738.962800:0:14975:0:(import.c:65:import_set_state_nolock()) ffff97194756e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061738.962823:0:14975:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c851c516-4d06-4311-8aaf-200a057f0d40+6:2352:x1875966758595200:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 239us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061738.962830:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1789061738.963315:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758595328 00000100:00100000:3.0:1789061738.963326:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758595328 00000100:00100000:3.0:1789061738.963377:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1789061738.963386:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+6:13733:x1875966758595328:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789061738.967759:0:14294:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4294us 00000004:00200000:0.0:1789061738.986991:0:14294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789061738.987171:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+6:13733:x1875966758595328:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 23776us (25693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061738.987190:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1789061739.179001:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061739.179189:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758595456 00000100:00100000:3.0:1789061739.179203:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758595456 00000100:00100000:3.0:1789061739.179275:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1789061739.179289:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+6:13776:x1875966758595456:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:3.0:1789061739.179317:0:14291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061739.179362:0:14291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9bb04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a452 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061739.179461:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9bb0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061739.179479:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9bb0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061739.179564:0:14291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9bb0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061739.179615:0:14291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789061739.179619:0:14291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789061739.179668:0:14291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9bb0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061739.179700:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042e00/0x427fa11dc4a9bb04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a452 expref: 8 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061739.179724:0:14291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9bb0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a452 expref: 7 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061739.179734:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636400) 00010000:00010000:3.0:1789061739.179737:0:14291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789061739.179742:0:14291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042800, rc 0) 00000100:00100000:3.0:1789061739.179834:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+7:13776:x1875966758595456:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 549us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061739.179842:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:1.0:1789061739.262189:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061739.262228:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779561984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061739.262330:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061739.265431:0:14979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779561984 00000100:00100000:0.0:1789061739.265455:0:14979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779561984 00000100:00100000:0.0:1789061739.265602:0:14979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789061739.265620:0:14979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779561984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061739.265659:0:14979:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061739.265796:0:14979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779561984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (3466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061739.265805:0:14979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789061739.266060:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061739.266135:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779561984:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789061739.361658:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c851c516-4d06-4311-8aaf-200a057f0d40 00000100:00100000:3.0:1789061739.773853:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779562496:0@lo:400:kworker.0 00000100:00100000:2.0:1789061739.773853:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779562240:0@lo:400:kworker.0 00000100:00100000:0.0:1789061739.773967:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779562112:0@lo:400:kworker.0 00000100:00100000:1.0:1789061739.774098:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779562368:0@lo:400:kworker.0 00000100:00100000:3.0:1789061739.778742:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061739.778935:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779562496 00000100:00100000:3.0:1789061739.778948:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779562496 00000100:00100000:2.0:1789061739.778992:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061739.779018:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789061739.779030:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779562496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061739.779043:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779562752:0@lo:400:kworker.0 00000100:00100000:2.0:1789061739.779112:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061739.779127:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779562496:12345-0@lo:400:kworker.0 Request processed in 99us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061739.779136:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789061739.782005:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779562240 00000100:00100000:1.0:1789061739.782037:0:14975:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779562240 00000100:00100000:1.0:1789061739.782156:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061739.782171:0:14975:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779562240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061739.782308:0:14975:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779562240:12345-0@lo:400:kworker.0 Request processed in 140us (3315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061739.782316:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789061739.782474:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779562752 00000100:00100000:3.0:1789061739.782605:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779562752 00000100:00080000:3.0:1789061739.782649:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061739.782965:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779562496:0@lo:400:kworker.0 00000100:00100000:3.0:1789061739.783041:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789061739.783056:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779562752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061739.784032:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779562240:0@lo:400:kworker.0 00000100:00100000:3.0:1789061739.787106:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779562752:12345-0@lo:400:kworker.0 Request processed in 4036us (7975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061739.787129:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789061739.787389:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061739.797914:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061739.797993:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779562112 00000100:00100000:0.0:1789061739.798008:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779562112 00000100:00100000:0.0:1789061739.798094:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789061739.798110:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a79f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:3310:x1875966779562112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061739.798180:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a79f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:3310:x1875966779562112:12345-0@lo:400:kworker.0 Request processed in 75us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061739.798188:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789061739.798273:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779562112:0@lo:400:kworker.0 00000100:00100000:0.0:1789061739.798289:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779562624:0@lo:400:kworker.0 00000100:00100000:0.0:1789061739.798325:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061739.800582:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779562368 00000100:00100000:2.0:1789061739.800611:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779562368 00000100:00100000:1.0:1789061739.800683:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779562880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061739.800691:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789061739.800701:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875966779562368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061739.800831:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779562624 00000100:00100000:0.0:1789061739.800837:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779562624 00000100:00100000:0.0:1789061739.800890:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789061739.800899:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779562624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061739.801696:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061739.802119:0:14979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779562880 00000100:00100000:1.0:1789061739.802128:0:14979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779562880 00000100:00100000:1.0:1789061739.802204:0:14979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789061739.802214:0:14979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3312:x1875966779562880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061739.802241:0:14979:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061739.802301:0:14979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3312:x1875966779562880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061739.802308:0:14979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789061739.803004:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875966779562368:12345-0@lo:400:kworker.0 Request processed in 2302us (15613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061739.803015:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789061739.804163:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061739.804174:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061739.805848:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779562752:0@lo:400:kworker.0 00000100:00100000:1.0:1789061739.817145:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779562880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061739.817301:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779562368:0@lo:400:kworker.0 00000100:00100000:1.0:1789061739.817648:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779562624:0@lo:400:kworker.0 00000100:00100000:0.0:1789061739.817771:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779562624:12345-0@lo:400:kworker.0 Request processed in 8905us (11476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061739.817798:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789061739.901653:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789061739.942128:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789061739.942159:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c851c516-4d06-4311-8aaf-200a057f0d40 00000001:00100000:0.0:1789061739.942208:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789061740.927555:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789061741.247559:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789061741.300647:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061741.301328:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758595584 00000100:00100000:0.0:1789061741.301344:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758595584 00000100:00100000:0.0:1789061741.301556:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1789061741.301571:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+7:13829:x1875966758595584:12345-192.168.204.54@tcp:41:lfs.0 00000004:00000024:0.0:1789061741.301636:0:14293:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789061741.302245:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+7:13829:x1875966758595584:12345-192.168.204.54@tcp:41:lfs.0 Request processed in 672us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061741.302256:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00080000:3.0:1789061741.302871:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061741.314973:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061741.315201:0:14979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758595712 00000100:00100000:0.0:1789061741.315215:0:14979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758595712 00000100:00100000:0.0:1789061741.315301:0:14979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1789061741.315311:0:14979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c851c516-4d06-4311-8aaf-200a057f0d40+5:13829:x1875966758595712:12345-192.168.204.54@tcp:13:lfs.0 00002000:00000024:0.0:1789061741.315378:0:14979:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789061741.315582:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061741.315823:0:14979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c851c516-4d06-4311-8aaf-200a057f0d40+5:13829:x1875966758595712:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 511us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061741.315832:0:14979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1789061741.323657:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061741.324271:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758595840 00000100:00100000:1.0:1789061741.324286:0:14978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758595840 00000100:00100000:1.0:1789061741.324440:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1789061741.324454:0:14978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c851c516-4d06-4311-8aaf-200a057f0d40+5:13829:x1875966758595840:12345-192.168.204.54@tcp:13:lfs.0 00002000:00000024:1.0:1789061741.324560:0:14978:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061741.324698:0:14978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c851c516-4d06-4311-8aaf-200a057f0d40+5:13829:x1875966758595840:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 246us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061741.324706:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00080000:3.0:1789061741.333135:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789061741.572135:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061741.572351:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758595968 00000100:00100000:0.0:1789061741.572378:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758595968 00000100:00100000:0.0:1789061741.572451:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:0.0:1789061741.572464:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+10:13860:x1875966758595968:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789061741.572520:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061741.572554:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596ce00/0x427fa11dc4a9bb12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a459 expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061741.572595:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596ce00/0x427fa11dc4a9bb12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a459 expref: 11 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061741.572609:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596ce00/0x427fa11dc4a9bb12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a459 expref: 11 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061741.572621:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596ce00, rc 0) 00000100:00100000:0.0:1789061741.572707:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+11:13860:x1875966758595968:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 246us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061741.572714:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:2.0:1789061741.579262:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061741.579338:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758596096 00000100:00100000:0.0:1789061741.579352:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758596096 00000100:00100000:0.0:1789061741.579430:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:0.0:1789061741.579442:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+11:13860:x1875966758596096:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789061741.580061:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+11:13860:x1875966758596096:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 617us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061741.580071:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:3.0:1789061741.596982:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061741.597240:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758596224 00000100:00100000:2.0:1789061741.597255:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758596224 00000100:00100000:2.0:1789061741.597336:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:2.0:1789061741.597348:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+11:13860:x1875966758596224:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789061741.597789:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+11:13860:x1875966758596224:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 441us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061741.597799:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:1.0:1789061741.609667:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061741.610118:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758596352 00000100:00100000:0.0:1789061741.610133:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758596352 00000100:00100000:0.0:1789061741.610217:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:0.0:1789061741.610230:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+11:13867:x1875966758596352:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789061741.610658:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+11:13867:x1875966758596352:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 428us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061741.610667:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:3.0:1789061741.642816:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061741.645584:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758596480 00000100:00100000:1.0:1789061741.645606:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758596480 00000100:00100000:1.0:1789061741.645692:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:1.0:1789061741.645705:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+11:13867:x1875966758596480:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789061741.646113:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+11:13867:x1875966758596480:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 409us (3311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061741.646122:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:3.0:1789061741.655166:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061741.656068:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758596608 00000100:00100000:2.0:1789061741.656086:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758596608 00000100:00100000:2.0:1789061741.656176:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:2.0:1789061741.656190:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+11:13860:x1875966758596608:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789061741.656215:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061741.656243:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971944646800/0x427fa11dc4a9bb19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a483 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061741.656285:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971944646800/0x427fa11dc4a9bb19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a483 expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061741.658256:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971944646800/0x427fa11dc4a9bb19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a483 expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061741.658269:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971944646800, rc 0) 00000100:00100000:2.0:1789061741.658385:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+12:13860:x1875966758596608:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 2197us (3237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061741.658395:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:2.0:1789061741.674113:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061741.674297:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758596736 00000100:00100000:0.0:1789061741.674311:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758596736 00000100:00100000:0.0:1789061741.674396:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:0.0:1789061741.674409:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+12:13860:x1875966758596736:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789061741.674473:0:14286:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789061741.674547:0:14286:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789061741.674552:0:14286:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789061741.674556:0:14286:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789061741.674559:0:14286:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789061741.677142:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+12:13860:x1875966758596736:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 2719us (3037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061741.677162:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:1.0:1789061741.692468:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061741.692686:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758596864 00000100:00100000:0.0:1789061741.692701:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758596864 00000100:00100000:0.0:1789061741.692769:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:0.0:1789061741.692781:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+12:13860:x1875966758596864:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789061741.692804:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061741.692829:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9bb20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a48a expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061741.692864:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9bb20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a48a expref: 13 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061741.692876:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9bb20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a48a expref: 13 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061741.692887:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596c000, rc 0) 00000100:00100000:0.0:1789061741.692961:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+13:13860:x1875966758596864:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 183us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061741.692986:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:2.0:1789061741.701664:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061741.701824:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758596992 00000100:00100000:0.0:1789061741.701840:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758596992 00000100:00100000:0.0:1789061741.701922:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:0.0:1789061741.701935:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+13:13860:x1875966758596992:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789061741.702598:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+13:13860:x1875966758596992:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 661us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061741.702608:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:2.0:1789061741.711775:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061741.711918:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758597120 00000100:00100000:0.0:1789061741.711935:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758597120 00000100:00100000:0.0:1789061741.712011:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:0.0:1789061741.712024:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+13:13860:x1875966758597120:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789061741.712572:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+13:13860:x1875966758597120:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 547us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061741.712582:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:3.0:1789061741.723671:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061741.723866:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758597248 00000100:00100000:1.0:1789061741.723884:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758597248 00000100:00100000:1.0:1789061741.724019:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:1.0:1789061741.724032:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+13:13873:x1875966758597248:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789061741.724810:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+13:13873:x1875966758597248:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 774us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061741.724822:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:2.0:1789061741.731652:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061741.731953:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758597376 00000100:00100000:1.0:1789061741.731969:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758597376 00000100:00100000:1.0:1789061741.732057:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:1.0:1789061741.732080:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+13:13873:x1875966758597376:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789061741.732804:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+13:13873:x1875966758597376:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 732us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061741.732814:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:3.0:1789061741.753871:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061741.753955:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758597504 00000100:00100000:0.0:1789061741.753971:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758597504 00000100:00100000:0.0:1789061741.754058:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1789061741.754069:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1875966758597504:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789061741.754114:0:14291:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 84c9e5f0-47c8-4184-809e-4af95217330e@192.168.204.54@tcp t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:0.0:1789061741.754174:0:14291:0:(genops.c:1384:class_connect()) connect: client 84c9e5f0-47c8-4184-809e-4af95217330e, cookie 0x427fa11dc4a9bb27 00000004:00100000:0.0:1789061741.754221:0:14291:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789061741.754396:0:14291:0:(import.c:65:import_set_state_nolock()) ffff971946e64000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789061741.754540:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84c9e5f0-47c8-4184-809e-4af95217330e+6:2352:x1875966758597504:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 471us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061741.754569:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1789061741.767977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061741.768029:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061741.768075:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758597760 00000100:00100000:0.0:1789061741.768090:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758597760 00000100:00100000:0.0:1789061741.768185:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758597632 00000100:00100000:0.0:1789061741.768189:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758597632 00000100:00080000:3.0:1789061741.768384:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061741.771996:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1789061741.772051:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84c9e5f0-47c8-4184-809e-4af95217330e+7:13860:x1875966758597760:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789061741.772137:0:14293:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789061741.772271:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84c9e5f0-47c8-4184-809e-4af95217330e+7:13860:x1875966758597760:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 254us (4311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061741.777231:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061741.781284:0:14291:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789061741.781315:0:14291:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789061741.781684:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789061741.781701:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758597888 00000100:00100000:1.0:1789061741.781715:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758597888 00000100:00100000:0.0:1789061741.783052:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1789061741.783107:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1789061741.783127:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84c9e5f0-47c8-4184-809e-4af95217330e+7:0:x1875966758597632:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789061741.783170:0:14293:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789061741.783292:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84c9e5f0-47c8-4184-809e-4af95217330e+7:0:x1875966758597632:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 174us (15261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061741.783299:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1789061741.783312:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1789061741.783319:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84c9e5f0-47c8-4184-809e-4af95217330e+6:13860:x1875966758597888:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789061741.783351:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84c9e5f0-47c8-4184-809e-4af95217330e+6:13860:x1875966758597888:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 32us (6151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061741.783358:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1789061741.786296:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061741.786410:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758598016 00000100:00100000:1.0:1789061741.786426:0:14976:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758598016 00000100:00100000:1.0:1789061741.786526:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1789061741.786538:0:14976:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875966758598016:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789061741.786584:0:14976:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 84c9e5f0-47c8-4184-809e-4af95217330e@192.168.204.54@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:1.0:1789061741.786626:0:14976:0:(genops.c:1384:class_connect()) connect: client 84c9e5f0-47c8-4184-809e-4af95217330e, cookie 0x427fa11dc4a9bb2e 00002000:00100000:1.0:1789061741.786643:0:14976:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 84c9e5f0-47c8-4184-809e-4af95217330e/ffff97194756a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789061741.786658:0:14976:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789061741.788087:0:14976:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789061741.788150:0:14976:0:(import.c:65:import_set_state_nolock()) ffff97194756f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061741.788575:0:14976:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84c9e5f0-47c8-4184-809e-4af95217330e+6:2352:x1875966758598016:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 2034us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061741.788590:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1789061741.789119:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061741.789319:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758598144 00000100:00100000:2.0:1789061741.789331:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758598144 00000100:00100000:2.0:1789061741.789385:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1789061741.789396:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875966758598144:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789061741.789439:0:14977:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 84c9e5f0-47c8-4184-809e-4af95217330e@192.168.204.54@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1789061741.789482:0:14977:0:(genops.c:1384:class_connect()) connect: client 84c9e5f0-47c8-4184-809e-4af95217330e, cookie 0x427fa11dc4a9bb35 00002000:00100000:2.0:1789061741.789537:0:14977:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 84c9e5f0-47c8-4184-809e-4af95217330e/ffff971a7d0e8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789061741.789552:0:14977:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789061741.789839:0:14977:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789061741.789871:0:14977:0:(import.c:65:import_set_state_nolock()) ffff971a7d0ee000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789061741.793470:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84c9e5f0-47c8-4184-809e-4af95217330e+6:2352:x1875966758598144:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 4056us (4335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061741.793540:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789061741.798295:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061741.798417:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758598272 00000100:00100000:0.0:1789061741.798432:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758598272 00000100:00100000:0.0:1789061741.798548:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1789061741.798562:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84c9e5f0-47c8-4184-809e-4af95217330e+6:13860:x1875966758598272:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789061741.798682:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789061741.798787:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84c9e5f0-47c8-4184-809e-4af95217330e+6:13860:x1875966758598272:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 228us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061741.798796:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00010000:00010000:3.0:1789061741.950211:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061742.038608:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061742.038986:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758598400 00000100:00100000:1.0:1789061742.039002:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758598400 00000100:00100000:1.0:1789061742.039101:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1789061742.039115:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84c9e5f0-47c8-4184-809e-4af95217330e+6:13894:x1875966758598400:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:1.0:1789061742.039145:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061742.039179:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9bb3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a4b4 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061742.039270:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bb43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061742.039289:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bb43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061742.039318:0:14292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bb43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061742.039579:0:14292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789061742.039584:0:14292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789061742.039616:0:14292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bb43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061742.039653:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525600/0x427fa11dc4a9bb3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4b4 expref: 8 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061742.039677:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bb43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4b4 expref: 7 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061742.039687:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636400) 00010000:00010000:1.0:1789061742.039690:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789061742.039694:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524800, rc 0) 00000100:00100000:1.0:1789061742.039791:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84c9e5f0-47c8-4184-809e-4af95217330e+7:13894:x1875966758598400:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 679us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061742.039800:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00010000:00010000:3.0:1789061742.977041:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061744.000660:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061744.383133:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779563008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061744.383207:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061744.383290:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779563008 00000100:00100000:2.0:1789061744.383298:0:14978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779563008 00000100:00100000:2.0:1789061744.383353:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789061744.383362:0:14978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779563008:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789061744.383395:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789061744.383413:0:14978:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061744.383457:0:14978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779563008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061744.383465:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789061744.383529:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779563008:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789061744.435073:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 84c9e5f0-47c8-4184-809e-4af95217330e 00000001:00100000:1.0:1789061744.435090:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c851c516-4d06-4311-8aaf-200a057f0d40 00000001:00100000:2.0:1789061744.465549:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 84c9e5f0-47c8-4184-809e-4af95217330e 00000100:00100000:0.0:1789061744.894412:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779563520:0@lo:400:kworker.0 00000100:00100000:0.0:1789061744.894514:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061744.894583:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061744.894590:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779563392:0@lo:400:kworker.0 00000100:00100000:0.0:1789061744.894618:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061744.894675:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779563520 00000100:00100000:0.0:1789061744.894683:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779563520 00000100:00100000:0.0:1789061744.894734:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789061744.894744:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779563520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061744.894745:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779563392 00000100:00100000:1.0:1789061744.894752:0:14976:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779563392 00000100:00100000:1.0:1789061744.894802:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789061744.894808:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779563520:12345-0@lo:400:kworker.0 Request processed in 63us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061744.894816:0:14976:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779563392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061744.894821:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789061744.894878:0:14976:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779563392:12345-0@lo:400:kworker.0 Request processed in 66us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061744.894886:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789061744.894904:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779563264:0@lo:400:kworker.0 00000100:00100000:3.0:1789061744.894943:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061744.894968:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779563776:0@lo:400:kworker.0 00000100:00100000:1.0:1789061744.895008:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779563904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061744.895086:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061744.895128:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061744.895173:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779563136:0@lo:400:kworker.0 00000100:00100000:1.0:1789061744.895177:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779563776 00000100:00100000:1.0:1789061744.895183:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779563776 00000100:00100000:2.0:1789061744.895215:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061744.895239:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971947e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779563648:0@lo:400:kworker.0 00000100:00100000:2.0:1789061744.895267:0:16166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789061744.895275:0:16166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779563776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061744.895307:0:16166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875966779563776:12345-0@lo:400:kworker.0 Request processed in 33us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061744.895313:0:16166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789061744.896123:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779563520:0@lo:400:kworker.0 00000100:00100000:0.0:1789061744.896191:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779563904 00000100:00100000:0.0:1789061744.896197:0:14978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779563904 00000100:00100000:0.0:1789061744.896231:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789061744.896237:0:14978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779563904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061744.896270:0:14978:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061744.896321:0:14978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779563904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061744.896339:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789061744.896380:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789061744.896395:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779563392:0@lo:400:kworker.0 00000100:00100000:0.0:1789061744.896441:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779563904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061744.896479:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779563136 00000100:00100000:0.0:1789061744.896484:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779563136 00000100:00100000:0.0:1789061744.896529:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789061744.896536:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:3310:x1875966779563136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061744.896573:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:3310:x1875966779563136:12345-0@lo:400:kworker.0 Request processed in 37us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061744.896579:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789061744.896650:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779563264 00000100:00100000:0.0:1789061744.896654:0:14975:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779563264 00000100:00100000:0.0:1789061744.896677:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789061744.896683:0:14975:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779563264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061744.896713:0:14975:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875966779563264:12345-0@lo:400:kworker.0 Request processed in 30us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061744.896719:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789061744.896735:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061744.896742:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061744.898735:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875966779563776:0@lo:400:kworker.0 00000100:00100000:3.0:1789061744.898770:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779563264:0@lo:400:kworker.0 00000100:00100000:1.0:1789061744.899152:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061744.899192:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779563136:0@lo:400:kworker.0 00000100:00100000:1.0:1789061744.899217:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779563648 00000100:00100000:1.0:1789061744.899223:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779563648 00000100:00100000:1.0:1789061744.899286:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789061744.899295:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779563648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061744.899357:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875966779563648:12345-0@lo:400:kworker.0 Request processed in 63us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061744.899365:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1789061744.899384:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061744.899406:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971947e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875966779563648:0@lo:400:kworker.0 00000001:00100000:1.0:1789061744.986970:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 84c9e5f0-47c8-4184-809e-4af95217330e 00010000:00010000:3.0:1789061745.021720:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789061745.729141:0:16255:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789061746.046011:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061746.918270:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061746.918315:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061746.918363:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061746.918390:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061746.918407:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061746.918425:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061746.918461:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061746.918558:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758598656 00000100:00100000:2.0:1789061746.918574:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758598656 00000100:00100000:2.0:1789061746.918668:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758599040 00000100:00100000:2.0:1789061746.918672:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758599040 00000100:00100000:2.0:1789061746.918700:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1789061746.918710:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+6:2353:x1875966758598656:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061746.918815:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+6:2353:x1875966758598656:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 104us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061746.918824:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1789061746.918849:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1789061746.918855:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84c9e5f0-47c8-4184-809e-4af95217330e+6:2353:x1875966758599040:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061746.918881:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84c9e5f0-47c8-4184-809e-4af95217330e+6:2353:x1875966758599040:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061746.918887:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1789061746.919249:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758598912 00000100:00100000:3.0:1789061746.919256:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758598912 00000100:00100000:3.0:1789061746.919287:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758599168 00000100:00100000:3.0:1789061746.919290:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758599168 00000100:00100000:3.0:1789061746.919305:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758598784 00000100:00100000:3.0:1789061746.919307:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758598784 00000100:00100000:3.0:1789061746.919323:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758599296 00000100:00100000:3.0:1789061746.919326:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758599296 00000100:00100000:3.0:1789061746.919344:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1789061746.919352:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c851c516-4d06-4311-8aaf-200a057f0d40+5:2353:x1875966758598912:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061746.919390:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c851c516-4d06-4311-8aaf-200a057f0d40+5:2353:x1875966758598912:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 40us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061746.919413:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1789061746.919429:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1789061746.919436:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84c9e5f0-47c8-4184-809e-4af95217330e+5:2353:x1875966758599168:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061746.919466:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84c9e5f0-47c8-4184-809e-4af95217330e+5:2353:x1875966758599168:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061746.919472:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1789061746.919484:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1789061746.919510:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c851c516-4d06-4311-8aaf-200a057f0d40+5:2353:x1875966758598784:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061746.919535:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c851c516-4d06-4311-8aaf-200a057f0d40+5:2353:x1875966758598784:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061746.919610:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1789061746.919625:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1789061746.919632:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84c9e5f0-47c8-4184-809e-4af95217330e+5:2353:x1875966758599296:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061746.919661:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84c9e5f0-47c8-4184-809e-4af95217330e+5:2353:x1875966758599296:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061746.919668:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789061746.919768:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758598528 00000100:00100000:0.0:1789061746.919774:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758598528 00000100:00100000:0.0:1789061746.919817:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:0.0:1789061746.919824:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+13:2353:x1875966758598528:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061746.919850:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+13:2353:x1875966758598528:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061746.919866:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00080000:1.0:1789061746.920064:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061746.920070:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061746.920073:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789061747.076974:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061748.100148:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789061749.091427:0:16402:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0dd235d0 20000000:00000080:2.0:1789061749.091443:0:16402:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff971945bf8000 uarg=0000000000000000 20000000:01000000:2.0:1789061749.091482:0:16402:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789061749.091682:0:16402:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789061749.091687:0:16402:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789061749.092352:0:16403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1789061749.092659:0:16402:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789061749.099305:0:16402:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789061749.099347:0:16402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.099367:0:16402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9b841 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b83a expref: 18 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.099375:0:16402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9b88e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b887 expref: 18 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.099382:0:16402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9b9c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9b9c2 expref: 18 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.099391:0:16402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971944646400/0x427fa11dc4a9bae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a428 expref: 12 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.099398:0:16402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9bb20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a48a expref: 12 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.099404:0:16402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.099448:0:16402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9bb20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a48a expref: 12 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.099462:0:16402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9bb20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a48a expref: 12 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061749.099477:0:16402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16402:1875966779564032:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061749.099689:0:16402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971944646400/0x427fa11dc4a9bae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a428 expref: 12 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.099709:0:16402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971944646400/0x427fa11dc4a9bae8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a428 expref: 12 pid: 14286 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061749.099717:0:16402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16402:1875966779564160:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061749.099747:0:16402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9b9c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9b9c2 expref: 18 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.099754:0:16402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9b9c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9b9c2 expref: 18 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061749.099762:0:16402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16402:1875966779564288:0@lo:104: 00000100:00100000:2.0:1789061749.099796:0:16402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789061749.099838:0:16402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9b88e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9b887 expref: 18 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.099846:0:16402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9b88e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9b887 expref: 18 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061749.099909:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779564288 00000100:00100000:0.0:1789061749.099918:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779564288 00000100:00100000:0.0:1789061749.099963:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789061749.099972:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d02fbc9-0efc-41a2-bf6f-922e38501192+3:16402:x1875966779564288:12345-0@lo:104: 00010000:00010000:0.0:1789061749.099985:0:14275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b9c9 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.100032:0:14275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789061749.100038:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d02fbc9-0efc-41a2-bf6f-922e38501192+3:16402:x1875966779564288:12345-0@lo:104: Request processed in 67us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061749.100045:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789061749.101184:0:16402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbffb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16402:1875966779564416:0@lo:104: 00000100:00100000:2.0:1789061749.101290:0:16402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789061749.101339:0:16402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9b841 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x427fa11dc4a9b83a expref: 18 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.101350:0:16402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9b841 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x427fa11dc4a9b83a expref: 18 pid: 14283 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061749.101361:0:16402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16402:1875966779564544:0@lo:104: 00000100:00100000:2.0:1789061749.101386:0:16402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061749.101418:0:16402:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64d0b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061749.101438:0:16402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16402:1875966779564288:0@lo:104: 00000100:00100000:0.0:1789061749.101521:0:14275:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789061749.101534:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779564416 00000100:00100000:0.0:1789061749.101540:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779564416 00000100:00100000:0.0:1789061749.101567:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779564544 00000100:00100000:0.0:1789061749.101569:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779564544 00000100:00100000:0.0:1789061749.101580:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789061749.101586:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d02fbc9-0efc-41a2-bf6f-922e38501192+4:16402:x1875966779564416:12345-0@lo:104: 00010000:00010000:0.0:1789061749.101598:0:14275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b88e expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.101647:0:14275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789061749.101653:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d02fbc9-0efc-41a2-bf6f-922e38501192+4:16402:x1875966779564416:12345-0@lo:104: Request processed in 67us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061749.101660:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789061749.101675:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789061749.101680:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a760de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d02fbc9-0efc-41a2-bf6f-922e38501192+3:16402:x1875966779564544:12345-0@lo:104: 00010000:00010000:0.0:1789061749.101695:0:14275:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b841 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.101729:0:14275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789061749.101734:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a760de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d02fbc9-0efc-41a2-bf6f-922e38501192+3:16402:x1875966779564544:12345-0@lo:104: Request processed in 54us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061749.101741:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789061749.101780:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789061749.101786:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b9c9 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.101792:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f000 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061749.101796:0:15456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9b9c9 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.101803:0:15456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9b9c9 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061749.101810:0:15456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9b9c9 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061749.101816:0:15456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789061749.101840:0:15456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b9c9 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.101845:0:15456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061749.101863:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b9c9 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.101869:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4f63f000/0x427fa11dc4a9b9c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b9c9 expref: -99 pid: 15694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.101891:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789061749.101894:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b88e expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.101911:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f200 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061749.101914:0:15456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9b88e expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.101919:0:15456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9b88e expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061749.101925:0:15456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9b88e expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061749.101931:0:15456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789061749.101945:0:15456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b88e expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.101961:0:15456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061749.101976:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b88e expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.101982:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a4f63f200/0x427fa11dc4a9b887 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b88e expref: -99 pid: 14973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.101990:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061749.101993:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x427fa11dc4a9b841 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.102008:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042000 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1789061749.102010:0:15456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x427fa11dc4a9b841 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.102016:0:15456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x427fa11dc4a9b841 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061749.102022:0:15456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x427fa11dc4a9b841 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061749.102027:0:15456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789061749.102043:0:15456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b841 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.102048:0:15456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061749.102054:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b841 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.102061:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff971a82042000/0x427fa11dc4a9b83a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x427fa11dc4a9b841 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.102075:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061749.102077:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061749.102079:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061749.102093:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d02fbc9-0efc-41a2-bf6f-922e38501192:3313:1875966779564672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789061749.102121:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061749.102336:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779564800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061749.102365:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061749.102399:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061749.102405:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779564928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061749.102428:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061749.102454:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779564672 00000100:00100000:1.0:1789061749.102466:0:14278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779564672 00010000:00010000:1.0:1789061749.102510:0:14278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9b9c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b9c2 expref: 19 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061749.102526:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779564800 00000100:00100000:1.0:1789061749.102528:0:14278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779564800 00010000:00010000:1.0:1789061749.102540:0:14278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9b88e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b887 expref: 20 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061749.102549:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779564928 00000100:00100000:1.0:1789061749.102551:0:14278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779564928 00010000:00010000:1.0:1789061749.102560:0:14278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9b841 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b83a expref: 21 pid: 14283 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061749.102571:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789061749.102576:0:14278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d02fbc9-0efc-41a2-bf6f-922e38501192+21:3313:x1875966779564672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061749.102586:0:14278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061749.102590:0:14278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9b9c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b9c2 expref: 21 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061749.102600:0:14278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9b9c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9b9c2 expref: 21 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061749.102612:0:14278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7c524600/0x427fa11dc4a9b9c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9b9c2 expref: 21 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061749.102625:0:14278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061749.102656:0:14278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d02fbc9-0efc-41a2-bf6f-922e38501192+20:3313:x1875966779564672:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061749.102663:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789061749.102676:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789061749.102687:0:14278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:3310:x1875966779564800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061749.102695:0:14278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061749.102700:0:14278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9b88e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b887 expref: 19 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061749.102707:0:14278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9b88e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9b887 expref: 19 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061749.102716:0:14278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061749.102741:0:14278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:3310:x1875966779564800:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061749.102746:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789061749.102757:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789061749.102762:0:14278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a43178c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:3310:x1875966779564928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061749.102769:0:14278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061749.102772:0:14278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9b841 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x427fa11dc4a9b83a expref: 18 pid: 14283 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061749.102779:0:14278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9b841 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x427fa11dc4a9b83a expref: 18 pid: 14283 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061749.102787:0:14278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061749.102808:0:14278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a43178c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:3310:x1875966779564928:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061749.102814:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789061749.102868:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d02fbc9-0efc-41a2-bf6f-922e38501192:3313:1875966779564672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061749.102893:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779564928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061749.102912:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779564800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789061749.103021:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7c524000/0x427fa11dc4a9b88e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9b887 expref: 17 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061749.103031:0:16402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbffb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16402:1875966779564416:0@lo:104: 00010000:00010000:2.0:1789061749.103040:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7596da00/0x427fa11dc4a9b841 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x427fa11dc4a9b83a expref: 16 pid: 14283 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061749.103048:0:16402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16402:1875966779564544:0@lo:104: 00010000:00010000:2.0:1789061749.103830:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061749.103838:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061749.109801:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061749.110029:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758599424 00000100:00100000:0.0:1789061749.110039:0:14278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758599424 00010000:00010000:0.0:1789061749.110079:0:14278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9bb20 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a48a expref: 13 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061749.110125:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789061749.110134:0:14278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:282d5b89-cba7-4159-9b75-d113061ec0de+13:2355:x1875966758599424:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061749.110149:0:14278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061749.110154:0:14278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9bb20 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a48a expref: 13 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.110167:0:14278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9bb20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a48a expref: 13 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061749.110187:0:14278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061749.110249:0:14278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:282d5b89-cba7-4159-9b75-d113061ec0de+13:2355:x1875966758599424:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 116us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061749.110257:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00010000:00010000:2.0:1789061749.110856:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971a7596c000/0x427fa11dc4a9bb20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a48a expref: 12 pid: 14284 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061749.110872:0:16402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16402:1875966779564032:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061749.110884:0:16402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16402:1875966779564160:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061749.110932:0:16402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061749.111182:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061749.111939:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758599552 00000100:00100000:2.0:1789061749.111949:0:14276:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758599552 00010000:00010000:2.0:1789061749.111992:0:14276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff971944646400/0x427fa11dc4a9bae8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a428 expref: 12 pid: 14286 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061749.112028:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1789061749.112037:0:14276:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282d5b89-cba7-4159-9b75-d113061ec0de+12:2356:x1875966758599552:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061749.112048:0:14276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061749.112064:0:14276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff971944646400/0x427fa11dc4a9bae8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a428 expref: 12 pid: 14286 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.112074:0:14276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff971944646400/0x427fa11dc4a9bae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a428 expref: 12 pid: 14286 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.112089:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971944646400/0x427fa11dc4a9bae8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a428 expref: 12 pid: 14286 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.112106:0:14276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.112114:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.112128:0:14276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.112134:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.112140:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.112147:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.112152:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944646a00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061749.112156:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.112163:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.112179:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061749.112187:0:14276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061749.112608:0:14276:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282d5b89-cba7-4159-9b75-d113061ec0de+11:2356:x1875966758599552:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 569us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061749.112617:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00010000:3.0:1789061749.112880:0:16402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061749.112890:0:16402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061749.112917:0:16402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff971944646a00/0x427fa11dc4a9bb4a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061749.117629:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061749.501857:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779565056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061749.501959:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061749.502089:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779565056 00000100:00100000:2.0:1789061749.502098:0:14978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779565056 00000100:00100000:2.0:1789061749.502163:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789061749.502173:0:14978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779565056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061749.502206:0:14978:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789061749.502251:0:14978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779565056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061749.502258:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789061749.502336:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061749.502371:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779565056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061750.023024:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779565568:0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.023102:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061750.023162:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789061750.023169:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d02fbc9-0efc-41a2-bf6f-922e38501192:3312:1875966779565184:0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.023199:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061750.023221:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779565696:0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.023241:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061750.023267:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779565312:0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.023295:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061750.023322:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875966779565824:0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.023343:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061750.023363:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061750.023370:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779565440:0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.023389:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061750.023425:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779565568 00000100:00100000:3.0:1789061750.023434:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779565568 00000100:00100000:3.0:1789061750.023513:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779565696 00000100:00100000:3.0:1789061750.023517:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779565696 00000100:00100000:3.0:1789061750.023542:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779565824 00000100:00100000:3.0:1789061750.023545:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779565824 00000100:00100000:3.0:1789061750.023560:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789061750.023569:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779565568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.023621:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875966779565568:12345-0@lo:400:kworker.0 Request processed in 53us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061750.023627:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789061750.023645:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789061750.023651:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779565696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.023676:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875966779565696:12345-0@lo:400:kworker.0 Request processed in 26us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061750.023682:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789061750.023694:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789061750.023699:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875966779565824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.023726:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875966779565824:12345-0@lo:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061750.023733:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789061750.023754:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779565312 00000100:00100000:3.0:1789061750.023756:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779565184 00000100:00100000:2.0:1789061750.023761:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779565312 00000100:00100000:3.0:1789061750.023762:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779565184 00000100:00100000:3.0:1789061750.023801:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789061750.023804:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779565440 00000100:00100000:3.0:1789061750.023810:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:3312:x1875966779565184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061750.023810:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779565440 00000100:00100000:2.0:1789061750.023839:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789061750.023849:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:3312:x1875966779565184:12345-0@lo:400:kworker.0 Request processed in 40us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061750.023851:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779565312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.023863:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789061750.023910:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779565312:12345-0@lo:400:kworker.0 Request processed in 61us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061750.023917:0:14975:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789061750.023918:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789061750.023932:0:14975:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789061750.023935:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789061750.023943:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779565440:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789061750.023955:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061750.023960:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061750.023988:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779565440:12345-0@lo:400:kworker.0 Request processed in 45us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061750.023995:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789061750.024105:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779565440:0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.024120:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779565312:0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.024129:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875966779565824:0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.024182:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d02fbc9-0efc-41a2-bf6f-922e38501192:3312:1875966779565184:0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.024194:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875966779565696:0@lo:400:kworker.0 00000100:00100000:3.0:1789061750.024204:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875966779565568:0@lo:400:kworker.0 00000100:00100000:2.0:1789061750.026042:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061750.026063:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779565952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061750.026131:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061750.026268:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779565952 00000100:00100000:1.0:1789061750.026277:0:14978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779565952 00000100:00100000:1.0:1789061750.026333:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789061750.026343:0:14978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779565952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061750.026384:0:14978:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789061750.026438:0:14978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779565952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061750.026445:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789061750.026541:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779565952:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789061750.141763:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789061750.336221:0:14288:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789061750.336231:0:14288:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97194505f000 from 10 10000000:01000000:2.0:1789061750.336237:0:14288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789061750.336287:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971944646c00/0x427fa11dc4a9bb51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061750.336299:0:14288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971944646c00/0x427fa11dc4a9bb51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061750.336310:0:14288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971944646c00/0x427fa11dc4a9bb51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061750.336335:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061750.336403:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061750.336456:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64d0b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061750.336759:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779566080 00000100:00100000:3.0:1789061750.336768:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779566080 00000100:00100000:3.0:1789061750.336821:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789061750.336831:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a453d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+16:14288:x1875966779566080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061750.336847:0:14286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061750.336863:0:14286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a82042400/0x427fa11dc4a9bb58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9bb51 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061750.336909:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a82042400/0x427fa11dc4a9bb58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9bb51 expref: 17 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061750.337071:0:14286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a82042400/0x427fa11dc4a9bb58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9bb51 expref: 17 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061750.337081:0:14286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042400, rc 0) 00000100:00100000:3.0:1789061750.337149:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a453d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:14288:x1875966779566080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 319us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061750.337156:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789061750.338897:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061750.338924:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971944646c00/0x427fa11dc4a9bb51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9bb58 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061750.338936:0:14288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971944646c00/0x427fa11dc4a9bb51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9bb58 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061750.339030:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061750.339082:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061750.339123:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64d0b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061750.339627:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779566208 00000100:00100000:3.0:1789061750.339636:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779566208 00000100:00100000:3.0:1789061750.339832:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789061750.339843:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a453d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:14288:x1875966779566208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061750.340147:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a453d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:14288:x1875966779566208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061750.340155:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789061750.343299:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061750.343372:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061750.343447:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061750.343515:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64d0b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061750.344099:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779566336 00000100:00100000:0.0:1789061750.344107:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779566336 00000100:00100000:0.0:1789061750.344159:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789061750.344170:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a453d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:14288:x1875966779566336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061750.344442:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a453d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:14288:x1875966779566336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 273us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061750.344451:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789061750.346703:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789061750.347949:0:16445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789061750.348237:0:14288:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789061750.348261:0:14288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061750.348272:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971944646c00/0x427fa11dc4a9bb51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9bb58 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061750.348283:0:14288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971944646c00/0x427fa11dc4a9bb51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9bb58 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061750.348295:0:14288:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789061750.348298:0:14288:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff971a56f4c000 from 10 10000000:01000000:2.0:1789061750.348300:0:14288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789061750.348335:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971944647400/0x427fa11dc4a9bb5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061750.348343:0:14288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971944647400/0x427fa11dc4a9bb5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061750.348354:0:14288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971944647400/0x427fa11dc4a9bb5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061750.348390:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061750.348458:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061750.348527:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64d0b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061750.348546:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779566464 00000100:00100000:3.0:1789061750.348555:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779566464 00000100:00100000:3.0:1789061750.348610:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789061750.348620:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+17:14288:x1875966779566464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061750.348633:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061750.348657:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a82042e00/0x427fa11dc4a9bb66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9bb5f expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061750.348681:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a82042e00/0x427fa11dc4a9bb66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9bb5f expref: 18 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061750.348693:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a82042e00/0x427fa11dc4a9bb66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9bb5f expref: 18 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061750.348701:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042e00, rc 0) 00000100:00100000:3.0:1789061750.348740:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:14288:x1875966779566464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061750.348747:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789061750.349272:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061750.349287:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971944647400/0x427fa11dc4a9bb5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9bb66 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061750.349299:0:14288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971944647400/0x427fa11dc4a9bb5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9bb66 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061750.349356:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061750.349388:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061750.349411:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64d0b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061750.349454:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779566592 00000100:00100000:0.0:1789061750.349460:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779566592 00000100:00100000:0.0:1789061750.349527:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789061750.349536:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:14288:x1875966779566592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061750.350509:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:14288:x1875966779566592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 953us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061750.350526:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789061750.350832:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061750.350893:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061750.351465:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061750.351533:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fd88540 going to sleep for 11 seconds 00000100:00100000:1.0:1789061750.351556:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779566720 00000100:00100000:1.0:1789061750.351563:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779566720 00000100:00100000:1.0:1789061750.351605:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789061750.351614:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:14288:x1875966779566720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061750.351821:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:14288:x1875966779566720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061750.351829:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789061750.351893:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789061750.353848:0:16449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789061750.354388:0:14288:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789061750.354429:0:14288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789061750.354441:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971944647400/0x427fa11dc4a9bb5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9bb66 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061750.354467:0:14288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971944647400/0x427fa11dc4a9bb5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9bb66 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061750.354479:0:14288:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789061750.354482:0:14288:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97194517e000 from 10 10000000:01000000:1.0:1789061750.354504:0:14288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789061750.354542:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c525800/0x427fa11dc4a9bb6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061750.354552:0:14288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff971a7c525800/0x427fa11dc4a9bb6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061750.354564:0:14288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff971a7c525800/0x427fa11dc4a9bb6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061750.354591:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789061750.354657:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061750.354694:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a5cdb89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061750.356110:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779566848 00000100:00100000:1.0:1789061750.356123:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779566848 00000100:00100000:1.0:1789061750.356182:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789061750.356192:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+18:14288:x1875966779566848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061750.356208:0:14286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061750.356225:0:14286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9bb74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x427fa11dc4a9bb6d expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061750.356251:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9bb74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x427fa11dc4a9bb6d expref: 19 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061750.356276:0:14286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c525600/0x427fa11dc4a9bb74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x427fa11dc4a9bb6d expref: 19 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061750.356284:0:14286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525600, rc 0) 00000100:00100000:1.0:1789061750.356353:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:14288:x1875966779566848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061750.356360:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789061750.356820:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061750.356841:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff971a7c525800/0x427fa11dc4a9bb6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9bb74 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061750.356852:0:14288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff971a7c525800/0x427fa11dc4a9bb6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x427fa11dc4a9bb74 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061750.356938:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061750.356982:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061750.357004:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061750.357020:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779566976 00000100:00100000:3.0:1789061750.357024:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779566976 00000100:00100000:3.0:1789061750.357059:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789061750.357068:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:14288:x1875966779566976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061750.357321:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:14288:x1875966779566976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061750.357329:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789061750.357362:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779566976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061750.357389:0:14288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779567104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061750.357430:0:14288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061750.357453:0:14288:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a4fde06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061750.357464:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779567104 00000100:00100000:3.0:1789061750.357467:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779567104 00000100:00100000:3.0:1789061750.357512:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789061750.357520:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:14288:x1875966779567104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061750.357664:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:14288:x1875966779567104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061750.357679:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789061750.357731:0:14288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d02fbc9-0efc-41a2-bf6f-922e38501192:14288:1875966779567104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789061750.358353:0:16450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789061750.358523:0:14288:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789061750.358544:0:14288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061750.358553:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff971a7c525800/0x427fa11dc4a9bb6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9bb74 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061750.358565:0:14288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff971a7c525800/0x427fa11dc4a9bb6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x427fa11dc4a9bb74 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061750.890241:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061750.890566:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758599680 00000100:00100000:1.0:1789061750.890578:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758599680 00000100:00100000:1.0:1789061750.890628:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:1.0:1789061750.890637:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+11:13748:x1875966758599680:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061750.890656:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061750.890675:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c525a00/0x427fa11dc4a9bb7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a4bb expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061750.890703:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c525a00/0x427fa11dc4a9bb7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4bb expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061750.890713:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c525a00/0x427fa11dc4a9bb7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4bb expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061750.890721:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525a00, rc 0) 00000100:00100000:1.0:1789061750.890777:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+12:13748:x1875966758599680:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 142us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061750.890783:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:3.0:1789061750.896377:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061750.896532:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758599808 00000100:00100000:1.0:1789061750.896543:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758599808 00000100:00100000:1.0:1789061750.896609:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:1.0:1789061750.896619:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+12:13748:x1875966758599808:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061750.896933:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+12:13748:x1875966758599808:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 314us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061750.896941:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:1.0:1789061750.911008:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061750.911981:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758599936 00000100:00100000:3.0:1789061750.911998:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758599936 00000100:00100000:3.0:1789061750.912071:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:3.0:1789061750.912082:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+12:13748:x1875966758599936:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061750.912452:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282d5b89-cba7-4159-9b75-d113061ec0de+12:13748:x1875966758599936:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 370us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061750.912461:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:3.0:1789061750.926528:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061750.926707:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758600064 00000100:00100000:1.0:1789061750.926718:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758600064 00000100:00100000:1.0:1789061750.926780:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:1.0:1789061750.926792:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+12:13748:x1875966758600064:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061750.926824:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061750.926844:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff971a7c524c00/0x427fa11dc4a9bb82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a4c2 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061750.926886:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff971a7c524c00/0x427fa11dc4a9bb82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4c2 expref: 13 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061750.926899:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff971a7c524c00/0x427fa11dc4a9bb82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4c2 expref: 13 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061750.926908:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524c00, rc 0) 00000100:00100000:1.0:1789061750.926973:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+13:13748:x1875966758600064:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 183us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061750.926980:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:3.0:1789061750.939635:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061750.939844:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758600192 00000100:00100000:1.0:1789061750.939857:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758600192 00000100:00100000:1.0:1789061750.939930:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:1.0:1789061750.939953:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cabc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+13:13748:x1875966758600192:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061750.940687:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cabc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+13:13748:x1875966758600192:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 734us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061750.940698:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:0.0:1789061750.943890:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061750.944144:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758600320 00000100:00100000:1.0:1789061750.944155:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758600320 00000100:00100000:1.0:1789061750.944369:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:1.0:1789061750.944381:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75af6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+13:13748:x1875966758600320:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061750.944636:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75af6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282d5b89-cba7-4159-9b75-d113061ec0de+13:13748:x1875966758600320:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 256us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061750.944645:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00010000:00010000:3.0:1789061751.166699:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789061751.487549:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789061752.040466:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061752.040531:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061752.040555:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758600448 00000100:00100000:3.0:1789061752.040566:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061752.040568:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758600448 00000100:00100000:3.0:1789061752.040605:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061752.040627:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061752.040643:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:0.0:1789061752.040654:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758600960 00000100:00100000:3.0:1789061752.040655:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061752.040660:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75af5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+13:2355:x1875966758600448:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061752.040671:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758600960 00000100:00100000:3.0:1789061752.040689:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061752.040745:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75af5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+13:2355:x1875966758600448:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 93us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061752.040753:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00080000:1.0:1789061752.040809:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061752.040892:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758600576 00000100:00100000:0.0:1789061752.040897:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758600576 00000100:00100000:0.0:1789061752.040928:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1789061752.040936:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84c9e5f0-47c8-4184-809e-4af95217330e+6:2355:x1875966758600960:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061752.041033:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758600704 00000100:00100000:2.0:1789061752.041039:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758600704 00000100:00100000:2.0:1789061752.041063:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758601216 00000100:00100000:2.0:1789061752.041066:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758601216 00000100:00100000:2.0:1789061752.041076:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758600832 00000100:00100000:2.0:1789061752.041078:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758600832 00000100:00100000:2.0:1789061752.041137:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758601088 00000100:00100000:2.0:1789061752.041141:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758601088 00000100:00100000:3.0:1789061752.041144:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1789061752.041163:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1789061752.041171:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c851c516-4d06-4311-8aaf-200a057f0d40+5:2355:x1875966758600704:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061752.041203:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c851c516-4d06-4311-8aaf-200a057f0d40+5:2355:x1875966758600704:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 33us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061752.041213:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1789061752.041215:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+6:2355:x1875966758600576:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061752.041219:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84c9e5f0-47c8-4184-809e-4af95217330e+6:2355:x1875966758600960:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 280us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061752.041230:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1789061752.041235:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1789061752.041246:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84c9e5f0-47c8-4184-809e-4af95217330e+5:2355:x1875966758601216:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061752.041256:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+6:2355:x1875966758600576:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 102us (627us total) trans 0 rc 0/0 00000100:00080000:0.0:1789061752.041263:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061752.041268:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789061752.041272:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061752.041281:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84c9e5f0-47c8-4184-809e-4af95217330e+5:2355:x1875966758601216:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 37us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061752.041289:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1789061752.041306:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1789061752.041315:0:14975:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c851c516-4d06-4311-8aaf-200a057f0d40+5:2355:x1875966758600832:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061752.041342:0:14975:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c851c516-4d06-4311-8aaf-200a057f0d40+5:2355:x1875966758600832:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061752.041763:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1789061752.047819:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1789061752.047834:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1789061752.047861:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84c9e5f0-47c8-4184-809e-4af95217330e+5:2355:x1875966758601088:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789061752.047958:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84c9e5f0-47c8-4184-809e-4af95217330e+5:2355:x1875966758601088:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 124us (7269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061752.047966:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00010000:00010000:3.0:1789061752.189932:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061753.028558:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061753.031959:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758601344 00000100:00100000:0.0:1789061753.031975:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758601344 00000100:00100000:0.0:1789061753.032057:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789061753.032069:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+6:14404:x1875966758601344:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789061753.032091:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061753.032115:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9bb89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a4c9 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.032214:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bb90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.032229:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bb90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.032245:0:14292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bb90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.032259:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bb97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.032266:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bb97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.032272:0:14292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bb97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.033263:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ca00/0x427fa11dc4a9bb9e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.033280:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ca00/0x427fa11dc4a9bb9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.033289:0:14292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ca00/0x427fa11dc4a9bb9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061753.033319:0:14292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789061753.033323:0:14292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061753.033362:0:14292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ca00/0x427fa11dc4a9bb9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.033387:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bb90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.033394:0:14292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bb90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.033402:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bb90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.033409:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061753.033413:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bb90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.033422:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bb90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.033435:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636400) 00010000:00010000:0.0:1789061753.033438:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061753.033443:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bb90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.033450:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bb90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.033464:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bb97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.033471:0:14292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bb97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.033477:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bb97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.035976:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061753.035986:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bb97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.036000:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bb97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.036019:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff971a610ee000) 00010000:00010000:0.0:1789061753.036022:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061753.036027:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bb97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.036034:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bb97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.036104:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9bb89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4c9 expref: 8 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.036121:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596ca00/0x427fa11dc4a9bb9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4c9 expref: 7 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.036128:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff971a610ee100) 00010000:00010000:0.0:1789061753.036130:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061753.036133:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596ca00, rc 0) 00000100:00100000:1.0:1789061753.036391:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+7:14404:x1875966758601344:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 4321us (7843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061753.036400:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1789061753.051306:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061753.051398:0:16166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758601600 00000100:00100000:0.0:1789061753.051408:0:16166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758601600 00000100:00100000:0.0:1789061753.051470:0:16166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1789061753.051480:0:16166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+7:14404:x1875966758601600:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789061753.051554:0:16166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061753.051573:0:16166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9bba5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a4d0 expref: -99 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.051665:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.051680:0:16166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.051691:0:16166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.051750:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbb3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.051758:0:16166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.051765:0:16166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052337:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9bbba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052347:0:16166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9bbba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052356:0:16166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9bbba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061753.052367:0:16166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789061753.052723:0:16166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052731:0:16166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052738:0:16166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052744:0:16166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061753.052749:0:16166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052756:0:16166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052768:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff971a610ee100) 00010000:00010000:0.0:1789061753.052771:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061753.052776:0:16166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052782:0:16166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052795:0:16166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052800:0:16166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbb3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052806:0:16166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052831:0:16166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061753.052835:0:16166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.052842:0:16166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbb3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.055092:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff971a610ee000) 00010000:00010000:0.0:1789061753.055104:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061753.055112:0:16166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbb3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.055123:0:16166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbb3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.056765:0:16166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9bba5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4d0 expref: 10 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.056792:0:16166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596cc00/0x427fa11dc4a9bbba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4d0 expref: 9 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.056801:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee300) 00010000:00010000:0.0:1789061753.056804:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061753.056806:0:16166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596cc00, rc 0) 00000100:00100000:0.0:1789061753.062268:0:16166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+9:14404:x1875966758601600:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 10778us (10961us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789061753.062283:0:16166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1789061753.087284:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061753.092432:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758601728 00000100:00100000:3.0:1789061753.092460:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758601728 00000100:00100000:2.0:1789061753.095401:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1789061753.095436:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+9:14404:x1875966758601728:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789061753.095788:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+9:14404:x1875966758601728:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 368us (8517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061753.095797:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1789061753.133573:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061753.134178:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758601856 00000100:00100000:0.0:1789061753.134194:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758601856 00000100:00100000:0.0:1789061753.134277:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1789061753.134289:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+9:14410:x1875966758601856:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789061753.134317:0:14291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061753.134345:0:14291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9bbc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a4d7 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134447:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134466:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134480:0:14291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134553:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134573:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134581:0:14291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134885:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134894:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbcf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134914:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134920:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596c000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061753.134925:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134934:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134948:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636400) 00010000:00010000:0.0:1789061753.134951:0:14291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061753.134958:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134965:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bbcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134980:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134986:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134992:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.134997:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061753.135000:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.135014:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.135022:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff971a610ee000) 00010000:00010000:0.0:1789061753.135025:0:14291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061753.135028:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.135034:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bbd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.135076:0:14291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9bbc8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4d7 expref: 10 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.135086:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636400) 00010000:00010000:0.0:1789061753.135088:0:14291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061753.135092:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9bbc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4d7 expref: 10 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.135102:0:14291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596da00, rc 0) 00000100:00100000:0.0:1789061753.135180:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+9:14410:x1875966758601856:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 893us (1692us total) trans 0 rc 301/301 00000100:00100000:0.0:1789061753.135187:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1789061753.146908:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061753.147471:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758601984 00000100:00100000:1.0:1789061753.147538:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758601984 00000100:00100000:1.0:1789061753.147621:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1789061753.147635:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c851c516-4d06-4311-8aaf-200a057f0d40+9:14410:x1875966758601984:12345-192.168.204.54@tcp:700:lfs.0 00000100:00100000:1.0:1789061753.147765:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c851c516-4d06-4311-8aaf-200a057f0d40+9:14410:x1875966758601984:12345-192.168.204.54@tcp:700:lfs.0 Request processed in 133us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061753.147775:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1789061753.159450:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061753.165512:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758602240 00000100:00100000:3.0:1789061753.165537:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758602240 00000100:00100000:2.0:1789061753.165889:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1789061753.165906:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+9:14410:x1875966758602240:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:2.0:1789061753.165999:0:14292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061753.166040:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9bb0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a452 expref: 9 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.166074:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636400) 00010000:00010000:2.0:1789061753.166080:0:14292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061753.166395:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.166418:0:14292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bb43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4b4 expref: 5 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.166428:0:14292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.166483:0:14292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bb43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4b4 expref: 5 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.166565:0:14292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bb43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4b4 expref: 5 pid: 14292 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061753.166582:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14292:1875966779567232:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061753.166729:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ccceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061753.171320:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14292:1875966779567232:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061753.171365:0:14292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061753.171937:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061753.172571:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758602368 00000100:00100000:0.0:1789061753.172584:0:14277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758602368 00010000:00010000:0.0:1789061753.172635:0:14277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bb43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4b4 expref: 6 pid: 14292 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061753.172707:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1789061753.172719:0:14277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84c9e5f0-47c8-4184-809e-4af95217330e+6:2356:x1875966758602368:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061753.172739:0:14277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061753.172747:0:14277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bb43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4b4 expref: 6 pid: 14292 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.172761:0:14277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bb43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4b4 expref: 6 pid: 14292 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.172789:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bb43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4b4 expref: 6 pid: 14292 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.172810:0:14277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636400) 00010000:00010000:0.0:1789061753.172817:0:14277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.172838:0:14277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.172847:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.173272:0:14277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061753.173412:0:14277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84c9e5f0-47c8-4184-809e-4af95217330e+5:2356:x1875966758602368:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 692us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061753.173421:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00010000:00010000:2.0:1789061753.173527:0:14292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.173536:0:14292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.173575:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bbe4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.173587:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bbe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.173595:0:14292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bbe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061753.175408:0:14292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789061753.175439:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.175451:0:14292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.175459:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.175466:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944647800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061753.175472:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.175481:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.175553:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636400) 00010000:00010000:2.0:1789061753.175556:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061753.175563:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.175570:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bbdd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061753.175597:0:14292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f0feaa4 reply state 00000000dacf4b95 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bbe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061753.175609:0:14292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061753.175738:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+10:14410:x1875966758602240:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 9832us (16302us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789061753.175749:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:2.0:1789061753.181649:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bbe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.181675:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bbe4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.181685:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bbe4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.181693:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944646400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061753.181699:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bbe4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.181709:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bbe4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.181766:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff971a6139c800) 00010000:00010000:2.0:1789061753.181771:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061753.181779:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bbe4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.181786:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bbe4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.214364:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061753.315745:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061753.315858:0:16166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758602496 00000100:00100000:3.0:1789061753.315871:0:16166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758602496 00000100:00100000:3.0:1789061753.315942:0:16166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1789061753.315956:0:16166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+9:14418:x1875966758602496:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:3.0:1789061753.315987:0:16166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061753.316014:0:16166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bbeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a4de expref: -99 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.316091:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9bbf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.316106:0:16166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9bbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.316117:0:16166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9bbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061753.316167:0:16166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789061753.316172:0:16166:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789061753.316210:0:16166:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9bbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.316253:0:16166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bbeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4de expref: 11 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.316271:0:16166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042800/0x427fa11dc4a9bbf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4de expref: 10 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.316279:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636e00) 00010000:00010000:3.0:1789061753.316281:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789061753.316284:0:16166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a82042800, rc 0) 00000100:00100000:3.0:1789061753.316344:0:16166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+10:14418:x1875966758602496:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 392us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061753.316351:0:16166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1789061753.349632:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061753.349732:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758602624 00000100:00100000:0.0:1789061753.349773:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758602624 00000100:00100000:0.0:1789061753.349896:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789061753.349909:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84c9e5f0-47c8-4184-809e-4af95217330e+5:14419:x1875966758602624:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789061753.349937:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061753.349965:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9bbf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a4e5 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.350447:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bc00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.350468:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bc00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.350484:0:14293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bc00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061753.350576:0:14293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789061753.350580:0:14293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061753.350728:0:14293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bc00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.350768:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596da00/0x427fa11dc4a9bbf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4e5 expref: 7 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.350794:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d600/0x427fa11dc4a9bc00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4e5 expref: 6 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.350805:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636e00) 00010000:00010000:0.0:1789061753.350808:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061753.350813:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7596d600, rc 0) 00000100:00100000:0.0:1789061753.350937:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84c9e5f0-47c8-4184-809e-4af95217330e+6:14419:x1875966758602624:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1031us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061753.350947:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1789061753.354840:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061753.355206:0:16166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758602752 00000100:00100000:0.0:1789061753.356089:0:16166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758602752 00000100:00100000:0.0:1789061753.356205:0:16166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1789061753.356418:0:16166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84c9e5f0-47c8-4184-809e-4af95217330e+6:14419:x1875966758602752:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789061753.356450:0:16166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061753.356480:0:16166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bc07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a4ec expref: -99 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.357005:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9bc0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.357025:0:16166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9bc0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.357039:0:16166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9bc0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.357060:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f200/0x427fa11dc4a9bc15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.357067:0:16166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f200/0x427fa11dc4a9bc15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.357075:0:16166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f200/0x427fa11dc4a9bc15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.359983:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f000/0x427fa11dc4a9bc1c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360022:0:16166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f000/0x427fa11dc4a9bc1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360037:0:16166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f000/0x427fa11dc4a9bc1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061753.360091:0:16166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789061753.360095:0:16166:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061753.360117:0:16166:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f000/0x427fa11dc4a9bc1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360133:0:16166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9bc0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360140:0:16166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9bc0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360148:0:16166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9bc0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360155:0:16166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7596d800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061753.360160:0:16166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9bc0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360170:0:16166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9bc0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360184:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636e00) 00010000:00010000:0.0:1789061753.360187:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061753.360194:0:16166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9bc0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360213:0:16166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596d800/0x427fa11dc4a9bc0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360231:0:16166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f200/0x427fa11dc4a9bc15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360239:0:16166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f200/0x427fa11dc4a9bc15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360246:0:16166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f200/0x427fa11dc4a9bc15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360252:0:16166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63f200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:0.0:1789061753.360255:0:16166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f200/0x427fa11dc4a9bc15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360261:0:16166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f200/0x427fa11dc4a9bc15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360269:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff971a610ee000) 00010000:00010000:0.0:1789061753.360272:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061753.360276:0:16166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f200/0x427fa11dc4a9bc15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360282:0:16166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f200/0x427fa11dc4a9bc15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.360347:0:16166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7596c000/0x427fa11dc4a9bc07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4ec expref: 8 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.362468:0:16166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f000/0x427fa11dc4a9bc1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4ec expref: 7 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.362503:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff971a610eed00) 00010000:00010000:0.0:1789061753.362506:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061753.362510:0:16166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63f000, rc 0) 00000100:00100000:0.0:1789061753.362610:0:16166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84c9e5f0-47c8-4184-809e-4af95217330e+7:14419:x1875966758602752:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 6388us (7790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061753.362620:0:16166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1789061753.368782:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061753.372749:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758603008 00000100:00100000:2.0:1789061753.372766:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758603008 00000100:00100000:2.0:1789061753.372878:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1789061753.372889:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84c9e5f0-47c8-4184-809e-4af95217330e+7:14419:x1875966758603008:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061753.372911:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061753.372932:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bc23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a4f3 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061753.373027:0:14292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789061753.373163:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bc23 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4f3 expref: 9 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.373178:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636e00) 00010000:00010000:2.0:1789061753.373181:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061753.373186:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bc23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4f3 expref: 9 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.373202:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971944647000, rc 0) 00000100:00100000:2.0:1789061753.373304:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84c9e5f0-47c8-4184-809e-4af95217330e+8:14419:x1875966758603008:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 417us (4531us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789061753.373311:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1789061753.383803:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061753.384256:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758603264 00000100:00100000:3.0:1789061753.384273:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758603264 00000100:00100000:3.0:1789061753.384365:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1789061753.384383:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84c9e5f0-47c8-4184-809e-4af95217330e+8:14419:x1875966758603264:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:3.0:1789061753.384463:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061753.384523:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63f000/0x427fa11dc4a9bc1c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4ec expref: 8 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.384720:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff971a610eed00) 00010000:00010000:3.0:1789061753.384738:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061753.384773:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc31 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.384790:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.384829:0:14291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061753.385111:0:14291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028778cde reply state 00000000646efd4c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061753.385122:0:14291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789061753.385146:0:14291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789061753.387903:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84c9e5f0-47c8-4184-809e-4af95217330e+9:14419:x1875966758603264:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 3504us (4088us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789061753.387922:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00010000:00010000:1.0:1789061753.393725:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061753.393749:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:1.0:1789061753.393760:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc31 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.393772:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc31 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.393779:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061753.393785:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc31 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.393794:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc31 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.393830:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff971a43636a00) 00010000:00010000:1.0:1789061753.393834:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789061753.393840:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc31 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.393846:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc31 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061753.395631:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758603520 00000100:00100000:0.0:1789061753.395656:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758603520 00000100:00100000:1.0:1789061753.395843:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1789061753.395859:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84c9e5f0-47c8-4184-809e-4af95217330e+8:14419:x1875966758603520:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1789061753.396315:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84c9e5f0-47c8-4184-809e-4af95217330e+9:14419:x1875966758603520:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 457us (2589us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789061753.396324:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1789061753.421043:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061753.421550:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758603776 00000100:00100000:2.0:1789061753.421562:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758603776 00000100:00100000:2.0:1789061753.421632:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1789061753.421644:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84c9e5f0-47c8-4184-809e-4af95217330e+9:14419:x1875966758603776:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061753.421672:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061753.421697:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bc38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a4fa expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.421793:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bc3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.421810:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bc3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.421834:0:14293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bc3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.421850:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bc46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.421857:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bc46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.421863:0:14293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bc46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061753.422000:0:14293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789061753.422116:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bc3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422126:0:14293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bc3f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422133:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bc3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422140:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944646200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061753.422145:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bc3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422153:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bc3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422167:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636e00) 00010000:00010000:2.0:1789061753.422170:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061753.422176:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bc3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422181:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bc3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422198:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bc46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422203:0:14293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bc46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422209:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bc46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422223:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944647600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061753.422227:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bc46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422233:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bc46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422241:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff971a6139c800) 00010000:00010000:2.0:1789061753.422243:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061753.422246:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bc46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422251:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bc46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422293:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bc38 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4fa expref: 11 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422304:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636e00) 00010000:00010000:2.0:1789061753.422307:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061753.422323:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bc38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a4fa expref: 11 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.422333:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971944647200, rc 0) 00000100:00100000:3.0:1789061753.423225:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84c9e5f0-47c8-4184-809e-4af95217330e+10:14419:x1875966758603776:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1577us (2186us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789061753.423236:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1789061753.428945:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061753.429041:0:16166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758603904 00000100:00100000:0.0:1789061753.429052:0:16166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758603904 00000100:00100000:0.0:1789061753.429112:0:16166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:0.0:1789061753.429122:0:16166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84c9e5f0-47c8-4184-809e-4af95217330e+10:14419:x1875966758603904:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789061753.429158:0:16166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061753.429184:0:16166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ea00/0x427fa11dc4a9bc54 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a501 expref: -99 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.429300:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fa00/0x427fa11dc4a9bc5b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.429322:0:16166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fa00/0x427fa11dc4a9bc5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.429335:0:16166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fa00/0x427fa11dc4a9bc5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061753.429402:0:16166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789061753.429407:0:16166:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789061753.429430:0:16166:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fa00/0x427fa11dc4a9bc5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.429456:0:16166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ea00/0x427fa11dc4a9bc54 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a501 expref: 12 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.429477:0:16166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fa00/0x427fa11dc4a9bc5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a501 expref: 11 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.429538:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff971a610ee000) 00010000:00010000:0.0:1789061753.429542:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061753.429547:0:16166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a4f63fa00, rc 0) 00000100:00100000:0.0:1789061753.429624:0:16166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84c9e5f0-47c8-4184-809e-4af95217330e+11:14419:x1875966758603904:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 503us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061753.429631:0:16166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:2.0:1789061753.442636:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061753.442763:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758604032 00000100:00100000:1.0:1789061753.442775:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758604032 00000100:00100000:1.0:1789061753.442848:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1789061753.442859:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84c9e5f0-47c8-4184-809e-4af95217330e+11:14419:x1875966758604032:12345-192.168.204.54@tcp:37:lfs.0 00000100:00100000:2.0:1789061753.461621:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84c9e5f0-47c8-4184-809e-4af95217330e+11:14419:x1875966758604032:12345-192.168.204.54@tcp:37:lfs.0 Request processed in 18753us (18984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061753.461728:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1789061753.465348:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061753.465595:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758604288 00000100:00100000:0.0:1789061753.465605:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758604288 00000100:00100000:0.0:1789061753.465667:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1789061753.465676:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f742850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84c9e5f0-47c8-4184-809e-4af95217330e+11:14419:x1875966758604288:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789061753.466088:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f742850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84c9e5f0-47c8-4184-809e-4af95217330e+12:14419:x1875966758604288:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 411us (748us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789061753.466097:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000040:00080000:3.0:1789061753.534341:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789061753.551734:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061753.551852:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758604416 00000100:00100000:1.0:1789061753.551873:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758604416 00000100:00100000:1.0:1789061753.551940:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:1.0:1789061753.551953:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+10:14425:x1875966758604416:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1789061753.551976:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061753.551996:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bc62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a508 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552075:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bc69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552093:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bc69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552105:0:14292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bc69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552326:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bc70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552334:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bc70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552341:0:14292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bc70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552443:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9bc77 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552452:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9bc77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552460:0:14292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9bc77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061753.552523:0:14292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789061753.552527:0:14292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789061753.552566:0:14292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9bc77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552579:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bc69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552586:0:14292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bc69 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552593:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bc69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552608:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061753.552613:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bc69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552621:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bc69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552634:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636e00) 00010000:00010000:1.0:1789061753.552637:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061753.552643:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bc69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552650:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bc69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552663:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bc70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552668:0:14292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bc70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552674:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bc70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552678:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061753.552681:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bc70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552688:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bc70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552706:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff971a6af68b00) 00010000:00010000:1.0:1789061753.552709:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061753.552712:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bc70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552717:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bc70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552748:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bc62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a508 expref: 12 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552762:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524000/0x427fa11dc4a9bc77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a508 expref: 11 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.552769:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff971a610ee000) 00010000:00010000:1.0:1789061753.552771:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789061753.552774:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524000, rc 0) 00000100:00100000:1.0:1789061753.552865:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+11:14425:x1875966758604416:12345-192.168.204.54@tcp:101:bash.0 Request processed in 914us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061753.552873:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:1.0:1789061753.557043:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061753.557158:0:16166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758604672 00000100:00100000:0.0:1789061753.557171:0:16166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758604672 00000100:00100000:0.0:1789061753.557283:0:16166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1789061753.557294:0:16166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+11:14425:x1875966758604672:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789061753.557320:0:16166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061753.557343:0:16166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9bc7e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a50f expref: -99 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.557474:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.557535:0:16166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fa00/0x427fa11dc4a9bc5b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a501 expref: 11 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.557544:0:16166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.557582:0:16166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fa00/0x427fa11dc4a9bc5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a501 expref: 11 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.557595:0:16166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fa00/0x427fa11dc4a9bc5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a501 expref: 11 pid: 16166 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061753.557609:0:16166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971945e5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16166:1875966779567360:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789061753.557694:0:16166:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ceffcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061753.561060:0:16166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971945e5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16166:1875966779567360:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061753.561093:0:16166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061753.564626:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061753.565082:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758604800 00000100:00100000:2.0:1789061753.565094:0:14276:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758604800 00010000:00010000:2.0:1789061753.565424:0:14276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fa00/0x427fa11dc4a9bc5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a501 expref: 12 pid: 16166 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061753.565474:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1789061753.565526:0:14276:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84c9e5f0-47c8-4184-809e-4af95217330e+12:2355:x1875966758604800:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061753.565543:0:14276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061753.565552:0:14276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fa00/0x427fa11dc4a9bc5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a501 expref: 12 pid: 16166 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.565565:0:14276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fa00/0x427fa11dc4a9bc5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a501 expref: 12 pid: 16166 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.565589:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63fa00/0x427fa11dc4a9bc5b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a501 expref: 12 pid: 16166 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.565605:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff971a610ee000) 00010000:00010000:2.0:1789061753.565612:0:14276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.565621:0:14276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.565629:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.565677:0:14276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061753.565734:0:14276:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84c9e5f0-47c8-4184-809e-4af95217330e+11:2355:x1875966758604800:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 250us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061753.565741:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00010000:00010000:3.0:1789061753.565953:0:16166:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.565962:0:16166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.566002:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc8c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.566014:0:16166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.566023:0:16166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.566943:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9bc93 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.566957:0:16166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9bc93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.566966:0:16166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9bc93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061753.566978:0:16166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789061753.567007:0:16166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.567014:0:16166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.567022:0:16166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.567028:0:16166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e600 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061753.567033:0:16166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.567053:0:16166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.567065:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff971a610ee000) 00010000:00010000:3.0:1789061753.567068:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061753.567073:0:16166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.567079:0:16166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e600/0x427fa11dc4a9bc85 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061753.567094:0:16166:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e877121 reply state 000000005033527f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061753.567103:0:16166:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789061753.568419:0:16166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9bc7e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a50f expref: 14 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.568444:0:16166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9bc93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a50f expref: 13 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.568453:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:3.0:1789061753.568455:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789061753.568458:0:16166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476c00, rc 0) 00000100:00100000:3.0:1789061753.568640:0:16166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+14:14425:x1875966758604672:12345-192.168.204.54@tcp:101:bash.0 Request processed in 11347us (11606us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789061753.568649:0:16166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00010000:00010000:2.0:1789061753.575899:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.575918:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc8c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.575927:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc8c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.575934:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a82042000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061753.575939:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc8c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.575947:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc8c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.575967:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff971a43636300) 00010000:00010000:2.0:1789061753.575970:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061753.575975:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc8c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.575982:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a82042000/0x427fa11dc4a9bc8c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061753.584105:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061753.584262:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758604928 00000100:00100000:1.0:1789061753.584273:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758604928 00000100:00100000:1.0:1789061753.584332:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1789061753.584342:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+13:14425:x1875966758604928:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1789061753.584369:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061753.584402:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bca1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a516 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.584478:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bca8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.584643:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bca8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.584657:0:14292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bca8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061753.584704:0:14292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789061753.584711:0:14292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789061753.584736:0:14292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bca8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.584747:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bca8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.584770:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bca1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a516 expref: 15 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.584787:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bca8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a516 expref: 14 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.584795:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:1.0:1789061753.584798:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061753.584805:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524600, rc 0) 00000100:00100000:1.0:1789061753.584862:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+14:14425:x1875966758604928:12345-192.168.204.54@tcp:101:bash.0 Request processed in 522us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061753.584880:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1789061753.596366:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061753.596438:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758605184 00000100:00100000:2.0:1789061753.596449:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758605184 00000100:00100000:2.0:1789061753.596552:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1789061753.596562:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+14:14425:x1875966758605184:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:2.0:1789061753.597155:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+15:14425:x1875966758605184:12345-192.168.204.54@tcp:35:bash.0 Request processed in 593us (796us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789061753.597164:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1789061753.733892:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061753.736217:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758605440 00000100:00100000:3.0:1789061753.736253:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758605440 00000100:00100000:2.0:1789061753.746040:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:2.0:1789061753.746056:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+15:14435:x1875966758605440:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789061753.746084:0:14291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061753.746105:0:14291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a51d expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061753.746223:0:14291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789061753.746350:0:14291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcaf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a51d expref: 17 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.746366:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff971a43636e00) 00010000:00010000:2.0:1789061753.746369:0:14291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061753.746374:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a51d expref: 17 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.746391:0:14291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971944646200, rc 0) 00000100:00100000:2.0:1789061753.746475:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+16:14435:x1875966758605440:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 421us (12592us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789061753.746483:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:2.0:1789061753.764965:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061753.765131:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758605696 00000100:00100000:1.0:1789061753.765143:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758605696 00000100:00100000:1.0:1789061753.765250:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1789061753.765261:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+16:14435:x1875966758605696:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1789061753.765556:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+17:14435:x1875966758605696:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 295us (759us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789061753.765564:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1789061753.839636:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061753.839737:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758605952 00000100:00100000:3.0:1789061753.839749:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758605952 00000100:00100000:3.0:1789061753.839826:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1789061753.839837:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+17:14438:x1875966758605952:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789061753.839872:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061753.839893:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477200/0x427fa11dc4a9bcbd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a524 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.840005:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9bcc4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.840019:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9bcc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.840031:0:14293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9bcc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061753.840043:0:14293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789061753.840198:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477200/0x427fa11dc4a9bcbd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a524 expref: 20 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.840220:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9bcc4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a524 expref: 19 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.840229:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:3.0:1789061753.840232:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061753.840236:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476400, rc 0) 00000100:00100000:3.0:1789061753.840314:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+19:14438:x1875966758605952:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 479us (689us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789061753.840343:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1789061753.846644:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061753.850574:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061753.851160:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758606208 00000100:00100000:0.0:1789061753.851172:0:14277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758606208 00000100:00100000:0.0:1789061753.851304:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1789061753.851326:0:14277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c851c516-4d06-4311-8aaf-200a057f0d40+19:2353:x1875966758606208:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061753.851356:0:14277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061753.851379:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476400/0x427fa11dc4a9bcc4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a524 expref: 19 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.851398:0:14277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:0.0:1789061753.851403:0:14277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061753.851468:0:14277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c851c516-4d06-4311-8aaf-200a057f0d40+18:2353:x1875966758606208:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 155us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061753.851475:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1789061753.851579:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758606080 00000100:00100000:2.0:1789061753.851591:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758606080 00000100:00100000:2.0:1789061753.851623:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1789061753.851630:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+18:14438:x1875966758606080:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1789061753.851684:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.851698:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.851708:0:14291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.851736:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.851743:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcd2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.851750:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.851756:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944646200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061753.851762:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.851768:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcd2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.851776:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:2.0:1789061753.851779:0:14291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061753.851782:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcd2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.851797:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061753.851848:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+18:14438:x1875966758606080:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 218us (5215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061753.851854:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1789061753.857772:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061753.864272:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758606464 00000100:00100000:1.0:1789061753.864287:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758606464 00000100:00100000:1.0:1789061753.864652:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1789061753.864665:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c851c516-4d06-4311-8aaf-200a057f0d40+18:14438:x1875966758606464:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1789061753.864939:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c851c516-4d06-4311-8aaf-200a057f0d40+19:14438:x1875966758606464:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 276us (7179us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789061753.864946:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00010000:00010000:3.0:1789061754.237740:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061754.353930:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061754.354092:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758606720 00000100:00100000:3.0:1789061754.354103:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758606720 00000100:00100000:3.0:1789061754.354189:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:3.0:1789061754.354201:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+19:14469:x1875966758606720:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1789061754.354225:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061754.354244:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477200/0x427fa11dc4a9bcd9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a52b expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.354340:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9bce0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.354354:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9bce0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.354365:0:14293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9bce0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061754.354375:0:14293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789061754.354558:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477200/0x427fa11dc4a9bcd9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a52b expref: 22 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.354590:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9bce0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a52b expref: 21 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.354617:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:3.0:1789061754.354620:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061754.354624:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41476600, rc 0) 00000100:00100000:3.0:1789061754.354683:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+21:14469:x1875966758606720:12345-192.168.204.54@tcp:101:cat.0 Request processed in 485us (765us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789061754.354690:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00080000:0.0:1789061754.354889:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061754.366736:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061754.366934:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061754.367101:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758607104 00000100:00100000:2.0:1789061754.367113:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758607104 00000100:00100000:2.0:1789061754.367183:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1789061754.367194:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+21:14469:x1875966758607104:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:2.0:1789061754.367731:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+22:14469:x1875966758607104:12345-192.168.204.54@tcp:35:cat.0 Request processed in 537us (794us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789061754.367815:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:1.0:1789061754.377104:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758606848 00000100:00100000:1.0:1789061754.377122:0:14278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758606848 00000100:00100000:1.0:1789061754.377222:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:1.0:1789061754.377233:0:14278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c851c516-4d06-4311-8aaf-200a057f0d40+22:2354:x1875966758606848:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061754.377248:0:14278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061754.377274:0:14278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476600/0x427fa11dc4a9bce0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a52b expref: 22 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.377319:0:14278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:1.0:1789061754.377325:0:14278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061754.377401:0:14278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c851c516-4d06-4311-8aaf-200a057f0d40+21:2354:x1875966758606848:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 170us (10675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061754.377409:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1789061754.458724:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061754.458816:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758607360 00000100:00100000:2.0:1789061754.458827:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758607360 00000100:00100000:2.0:1789061754.458896:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:2.0:1789061754.458907:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+21:14475:x1875966758607360:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:2.0:1789061754.458934:0:14291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061754.458968:0:14291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcee lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a532 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.459077:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bcf5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.459093:0:14291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9bc93 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a50f expref: 22 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.459121:0:14291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bca8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a516 expref: 22 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.459130:0:14291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bcf5 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.459162:0:14291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bca8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a516 expref: 22 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.459177:0:14291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bca8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a516 expref: 22 pid: 14292 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061754.459192:0:14291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14291:1875966779567488:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061754.459309:0:14291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9bc93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a50f expref: 22 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.459319:0:14291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9bc93 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a50f expref: 22 pid: 16166 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061754.459328:0:14291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cbfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14291:1875966779567616:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789061754.459350:0:14291:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7ccceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061754.462610:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061754.462663:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061754.462831:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758607488 00000100:00100000:1.0:1789061754.462844:0:14277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758607488 00010000:00010000:1.0:1789061754.462899:0:14277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bca8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a516 expref: 23 pid: 14292 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061754.462940:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758607616 00000100:00100000:1.0:1789061754.462944:0:14277:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758607616 00010000:00010000:1.0:1789061754.462956:0:14277:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9bc93 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a50f expref: 24 pid: 16166 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061754.462981:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1789061754.462990:0:14277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4317b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c851c516-4d06-4311-8aaf-200a057f0d40+24:2353:x1875966758607488:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061754.463003:0:14277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061754.463010:0:14277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bca8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a516 expref: 24 pid: 14292 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.463023:0:14277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bca8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a516 expref: 24 pid: 14292 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.463047:0:14277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:1.0:1789061754.463052:0:14277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bcf5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.463075:0:14277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bcf5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.463082:0:14277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061754.463146:0:14277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4317b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c851c516-4d06-4311-8aaf-200a057f0d40+24:2353:x1875966758607488:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 157us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061754.463154:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1789061754.463206:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1789061754.463214:0:14277:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c851c516-4d06-4311-8aaf-200a057f0d40+23:2353:x1875966758607616:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061754.463221:0:14277:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061754.463226:0:14277:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9bc93 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a50f expref: 23 pid: 16166 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.463234:0:14277:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9bc93 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a50f expref: 23 pid: 16166 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.463246:0:14277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:1.0:1789061754.463249:0:14277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bcf5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.463256:0:14277:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bcf5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.463264:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bcf5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.463298:0:14277:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061754.463930:0:14277:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c851c516-4d06-4311-8aaf-200a057f0d40+23:2353:x1875966758607616:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 712us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061754.463950:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00010000:00010000:2.0:1789061754.464810:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bca8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a516 expref: 22 pid: 14292 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061754.464831:0:14291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14291:1875966779567488:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061754.464859:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476c00/0x427fa11dc4a9bc93 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a50f expref: 21 pid: 16166 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061754.464871:0:14291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cbfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14291:1875966779567616:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789061754.464897:0:14291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bcf5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.464907:0:14291:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bcf5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.464913:0:14291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bcf5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061754.464932:0:14291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789061754.465095:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944646200/0x427fa11dc4a9bcee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a532 expref: 22 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.465110:0:14291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647600/0x427fa11dc4a9bcf5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a532 expref: 21 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.465118:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:2.0:1789061754.465121:0:14291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789061754.465124:0:14291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971944647600, rc 0) 00000100:00100000:2.0:1789061754.465175:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+21:14475:x1875966758607360:12345-192.168.204.54@tcp:101:dd.0 Request processed in 6271us (6463us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789061754.465182:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1789061754.468726:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061754.468850:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758607872 00000100:00100000:3.0:1789061754.468861:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758607872 00000100:00100000:3.0:1789061754.468916:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:3.0:1789061754.468928:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+21:14475:x1875966758607872:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:3.0:1789061754.469254:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477400/0x427fa11dc4a9bd03 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.469275:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477400/0x427fa11dc4a9bd03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.469288:0:14293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477400/0x427fa11dc4a9bd03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789061754.469978:0:14293:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789061754.470030:0:14293:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009de7c1d4 reply state 00000000242b8b90 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477400/0x427fa11dc4a9bd03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061754.470042:0:14293:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061754.470166:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+24:14475:x1875966758607872:12345-192.168.204.54@tcp:36:dd.0 Request processed in 1239us (1449us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789061754.470175:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000020:00080000:3.0:1789061754.470194:0:14293:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789061754.472865:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477400/0x427fa11dc4a9bd03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.472883:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477400/0x427fa11dc4a9bd03 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.472891:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477400/0x427fa11dc4a9bd03 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.472897:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41477400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061754.472903:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477400/0x427fa11dc4a9bd03 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.472910:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477400/0x427fa11dc4a9bd03 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.472928:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:1.0:1789061754.472931:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061754.472936:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477400/0x427fa11dc4a9bd03 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.472943:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477400/0x427fa11dc4a9bd03 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061754.482899:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061754.483253:0:16166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758608000 00000100:00100000:1.0:1789061754.483264:0:16166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758608000 00000100:00100000:1.0:1789061754.483343:0:16166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1789061754.483354:0:16166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+23:14475:x1875966758608000:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:1.0:1789061754.483379:0:16166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061754.483416:0:16166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bd0a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a539 expref: -99 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.483478:0:16166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bd0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a539 expref: 24 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.483519:0:16166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bd0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a539 expref: 24 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.483541:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:1.0:1789061754.483545:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061754.483548:0:16166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524600, rc 0) 00000100:00100000:1.0:1789061754.483617:0:16166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+24:14475:x1875966758608000:12345-192.168.204.54@tcp:101:dd.0 Request processed in 265us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061754.483624:0:16166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1789061754.506749:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061754.507263:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758608256 00000100:00100000:3.0:1789061754.507274:0:14276:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758608256 00000100:00100000:3.0:1789061754.507412:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1789061754.507423:0:14276:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c851c516-4d06-4311-8aaf-200a057f0d40+24:14475:x1875966758608256:12345-192.168.204.54@tcp:103:dd.0 00010000:00010000:3.0:1789061754.507442:0:14276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061754.507468:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524600/0x427fa11dc4a9bd0a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a539 expref: 24 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.507538:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:3.0:1789061754.507544:0:14276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061754.507617:0:14276:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c851c516-4d06-4311-8aaf-200a057f0d40+23:14475:x1875966758608256:12345-192.168.204.54@tcp:103:dd.0 Request processed in 196us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061754.507625:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1789061754.511051:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061754.511145:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758608384 00000100:00100000:2.0:1789061754.511158:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758608384 00000100:00100000:2.0:1789061754.511243:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1789061754.511255:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+23:14475:x1875966758608384:12345-192.168.204.54@tcp:58:dd.0 00010000:00010000:2.0:1789061754.511380:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bd11 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.511397:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bd11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.511408:0:14292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bd11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789061754.512393:0:14292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789061754.512961:0:14292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789061754.513038:0:14292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789061754.513222:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+23:14475:x1875966758608384:12345-192.168.204.54@tcp:58:dd.0 Request processed in 1964us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061754.513235:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1789061754.515992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061754.516118:0:16166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758608512 00000100:00100000:1.0:1789061754.516129:0:16166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758608512 00000100:00100000:1.0:1789061754.516219:0:16166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:1.0:1789061754.516230:0:16166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+23:14475:x1875966758608512:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:1.0:1789061754.516255:0:16166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061754.516279:0:16166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9bd18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a540 expref: -99 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.516348:0:16166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bd11 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.516359:0:16166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9bd18 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a540 expref: 24 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.516401:0:16166:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bd11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.516434:0:16166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9bd18 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a540 expref: 24 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.516448:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:1.0:1789061754.516451:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061754.516456:0:16166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9bd18 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a540 expref: 24 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.516464:0:16166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c525200, rc 0) 00000100:00100000:1.0:1789061754.516565:0:16166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+24:14475:x1875966758608512:12345-192.168.204.54@tcp:101:dd.0 Request processed in 337us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061754.516572:0:16166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000040:00080000:3.0:1789061754.558116:0:14325:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789061754.558127:0:14325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789061754.558206:0:14325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789061754.558213:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789061754.558336:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1e8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14325:1875966779567744:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789061754.558456:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a5cdb8600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061754.565527:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061754.565643:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758608640 00000100:00100000:1.0:1789061754.565657:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758608640 00000100:00100000:1.0:1789061754.565718:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1789061754.565730:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c851c516-4d06-4311-8aaf-200a057f0d40+25:14476:x1875966758608640:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789061754.565825:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c851c516-4d06-4311-8aaf-200a057f0d40+25:14476:x1875966758608640:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 Request processed in 98us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061754.565834:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1789061754.566135:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1e8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14325:1875966779567744:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789061754.571610:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061754.572235:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758608768 00000100:00100000:3.0:1789061754.572247:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758608768 00000100:00100000:3.0:1789061754.572307:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1789061754.572317:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+24:14476:x1875966758608768:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789061754.572350:0:14293:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789061754.572483:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+24:14476:x1875966758608768:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 167us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061754.572534:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1789061754.579947:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061754.580274:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758608896 00000100:00100000:2.0:1789061754.580285:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758608896 00000100:00100000:2.0:1789061754.580418:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:2.0:1789061754.580440:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+24:14476:x1875966758608896:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789061754.580553:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647a00/0x427fa11dc4a9bd1f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580569:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944647a00/0x427fa11dc4a9bd1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580582:0:14291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944647a00/0x427fa11dc4a9bd1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580678:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580687:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580694:0:14291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580719:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd2d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580727:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580734:0:14291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061754.580773:0:14291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789061754.580778:0:14291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061754.580804:0:14291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580814:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647a00/0x427fa11dc4a9bd1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580821:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971944647a00/0x427fa11dc4a9bd1f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580827:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971944647a00/0x427fa11dc4a9bd1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580841:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944647a00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061754.580857:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944647a00/0x427fa11dc4a9bd1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580865:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944647a00/0x427fa11dc4a9bd1f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580877:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee300) 00010000:00010000:2.0:1789061754.580880:0:14291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061754.580885:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971944647a00/0x427fa11dc4a9bd1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580891:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944647a00/0x427fa11dc4a9bd1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580905:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580911:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd26 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580918:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580922:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944647000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061754.580926:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580931:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd26 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580948:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff971a6139c800) 00010000:00010000:2.0:1789061754.580951:0:14291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061754.580954:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd26 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580960:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580974:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580980:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd2d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580986:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580991:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944647800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061754.580994:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.580999:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd2d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.581005:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:2.0:1789061754.581007:0:14291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061754.581010:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd2d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.581015:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd2d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061754.581244:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+24:14476:x1875966758608896:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 815us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061754.581253:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:0.0:1789061754.589308:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061754.589420:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758609152 00000100:00100000:2.0:1789061754.589442:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758609152 00000100:00100000:3.0:1789061754.589755:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:3.0:1789061754.589769:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+24:14476:x1875966758609152:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061754.589803:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061754.589825:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477200/0x427fa11dc4a9bd34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a547 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.590297:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.590315:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.590328:0:14293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061754.590340:0:14293:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789061754.590641:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.590649:0:14293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd3b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.590655:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.590660:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944646400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:2.0:1789061754.590664:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.590671:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd3b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.590698:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:2.0:1789061754.590701:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789061754.590706:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd3b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.590712:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd3b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.590756:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477200/0x427fa11dc4a9bd34 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a547 expref: 26 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.590766:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff971a610ee300) 00010000:00010000:2.0:1789061754.590769:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061754.590773:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477200/0x427fa11dc4a9bd34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a547 expref: 26 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.590783:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41477200, rc 0) 00000100:00100000:2.0:1789061754.591035:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+25:14476:x1875966758609152:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1268us (1742us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789061754.591054:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:0.0:1789061754.594761:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061754.594877:0:16166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758609280 00000100:00100000:1.0:1789061754.594887:0:16166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758609280 00000100:00100000:1.0:1789061754.594941:0:16166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:1.0:1789061754.594966:0:16166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+25:14476:x1875966758609280:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789061754.595027:0:16166:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789061754.595151:0:16166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+25:14476:x1875966758609280:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 188us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061754.595159:0:16166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:1.0:1789061754.600217:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061754.600442:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758609536 00000100:00100000:2.0:1789061754.600455:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758609536 00000100:00100000:2.0:1789061754.600560:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:2.0:1789061754.600571:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+25:14476:x1875966758609536:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061754.600593:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061754.600618:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd49 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a54e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789061754.601679:0:14292:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1789061754.601690:0:14292:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789061754.601746:0:14292:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789061754.604637:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.604660:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.604673:0:14292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.604739:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd49 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a54e expref: 28 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.604761:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a54e expref: 27 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.604769:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff971a6139c800) 00010000:00010000:2.0:1789061754.604771:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061754.604774:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971944647800, rc 0) 00000100:00100000:2.0:1789061754.604864:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+27:14476:x1875966758609536:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 4295us (4657us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789061754.604873:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:0.0:1789061754.608958:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061754.609097:0:16166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758609792 00000100:00100000:1.0:1789061754.609108:0:16166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758609792 00000100:00100000:1.0:1789061754.609270:0:16166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:1.0:1789061754.609281:0:16166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+27:14476:x1875966758609792:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789061754.609341:0:16166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061754.609369:0:16166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944647800/0x427fa11dc4a9bd50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a54e expref: 27 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609390:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff971a6139c800) 00010000:00010000:1.0:1789061754.609401:0:16166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061754.609426:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bd5e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609440:0:16166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bd5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609450:0:16166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bd5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609465:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe1a9d2a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609472:0:16166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1a9d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609537:0:16166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1a9d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609604:0:16166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bd5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609611:0:16166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bd5e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609617:0:16166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bd5e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609622:0:16166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061754.609627:0:16166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bd5e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609635:0:16166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bd5e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609644:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff971a610ee000) 00010000:00010000:1.0:1789061754.609647:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061754.609651:0:16166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bd5e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609656:0:16166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bd5e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609666:0:16166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1a9d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609672:0:16166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1a9d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609686:0:16166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1a9d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609692:0:16166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061754.609695:0:16166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1a9d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609701:0:16166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd65 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe1a9d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609710:0:16166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe1a9d2a5 (ffff971a6af68b00) 00010000:00010000:1.0:1789061754.609712:0:16166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061754.609715:0:16166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd65 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe1a9d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.609720:0:16166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd65 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe1a9d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061754.609810:0:16166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+26:14476:x1875966758609792:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 531us (862us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789061754.609819:0:16166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:0.0:1789061754.620165:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061754.620930:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758609920 00000100:00100000:2.0:1789061754.620942:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758609920 00000100:00100000:2.0:1789061754.621201:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:2.0:1789061754.621214:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+26:14476:x1875966758609920:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061754.621249:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061754.621273:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd6c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a555 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.621311:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.621324:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.621347:0:14293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.621454:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944646400/0x427fa11dc4a9bd6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a555 expref: 28 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.621476:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647000/0x427fa11dc4a9bd73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a555 expref: 27 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.621501:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff971a6139cd00) 00010000:00010000:2.0:1789061754.621504:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789061754.621508:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971944647000, rc 0) 00000100:00100000:2.0:1789061754.621575:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+27:14476:x1875966758609920:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 364us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061754.621582:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:2.0:1789061754.621777:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061754.621801:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779567872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061754.621857:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061754.622186:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779567872 00000100:00100000:0.0:1789061754.622192:0:14978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779567872 00000100:00100000:0.0:1789061754.622246:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789061754.622262:0:14978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779567872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061754.622291:0:14978:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061754.622400:0:14978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875966779567872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061754.622407:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789061754.622692:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875966779567872:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789061754.622754:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061754.626438:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061754.626476:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758610176 00000100:00100000:3.0:1789061754.626514:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758610176 00000100:00100000:3.0:1789061754.626569:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:3.0:1789061754.626578:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+27:14476:x1875966758610176:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789061754.626660:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9bd7a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.626677:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9bd7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.626689:0:14291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9bd7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789061754.627072:0:14291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1789061754.627083:0:14291:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 528868594749ns, next at 529868592200ns, rc = 0 00000004:00010000:3.0:1789061754.627208:0:14291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cc2363e reply state 00000000173f0ac0 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9bd7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061754.627236:0:14291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061754.627345:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+29:14476:x1875966758610176:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 767us (915us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789061754.627353:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00010000:00010000:1.0:1789061754.630620:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9bd7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.630639:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9bd7a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.630648:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9bd7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.630669:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41477800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061754.630675:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9bd7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.630683:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9bd7a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.630702:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff971a6139cd00) 00010000:00010000:1.0:1789061754.630705:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789061754.630710:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9bd7a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.630716:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41477800/0x427fa11dc4a9bd7a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061754.638307:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061754.638355:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758610304 00000100:00100000:1.0:1789061754.638364:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758610304 00000100:00100000:1.0:1789061754.638846:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1789061754.638869:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+28:14476:x1875966758610304:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061754.638896:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061754.638915:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a55c expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.638974:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a55c expref: 29 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.638988:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a55c expref: 29 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.639029:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff971a6139cd00) 00010000:00010000:1.0:1789061754.639033:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061754.639036:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524400, rc 0) 00000100:00100000:1.0:1789061754.639093:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+29:14476:x1875966758610304:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 227us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061754.639100:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:0.0:1789061754.653721:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061754.653802:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758610432 00000100:00100000:2.0:1789061754.653813:0:14975:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758610432 00000100:00100000:2.0:1789061754.653878:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1789061754.653888:0:14975:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c851c516-4d06-4311-8aaf-200a057f0d40+5:2356:x1875966758610432:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789061754.654349:0:14975:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c851c516-4d06-4311-8aaf-200a057f0d40+6:2356:x1875966758610432:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 461us (636us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789061754.654357:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00080000:0.0:1789061754.654738:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789061754.678374:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061754.678411:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758610688 00000100:00100000:0.0:1789061754.678420:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758610688 00000100:00100000:0.0:1789061754.678466:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1789061754.678475:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+29:14476:x1875966758610688:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789061754.678725:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+30:14476:x1875966758610688:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 250us (359us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1789061754.678732:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1789061754.688701:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061754.688735:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758610944 00000100:00100000:3.0:1789061754.688745:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758610944 00000100:00100000:3.0:1789061754.688822:0:16166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1789061754.688832:0:16166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+30:14476:x1875966758610944:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789061754.688946:0:16166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+30:14476:x1875966758610944:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 115us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061754.688954:0:16166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1789061754.694126:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061754.694187:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758611072 00000100:00100000:2.0:1789061754.694199:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758611072 00000100:00100000:2.0:1789061754.694267:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1789061754.694277:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+30:14476:x1875966758611072:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061754.694298:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061754.694318:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944647a00/0x427fa11dc4a9bd88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a563 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.694383:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff971944646a00/0x427fa11dc4a9bd8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.694398:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971944646a00/0x427fa11dc4a9bd8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.694409:0:14293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971944646a00/0x427fa11dc4a9bd8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061754.694445:0:14293:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789061754.694467:0:14293:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff971944646a00/0x427fa11dc4a9bd8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.694547:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944647a00/0x427fa11dc4a9bd88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a563 expref: 32 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.694577:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff971944646a00/0x427fa11dc4a9bd8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a563 expref: 31 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.694596:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff971a6139cd00) 00010000:00010000:2.0:1789061754.694599:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789061754.694602:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971944646a00, rc 0) 00000100:00100000:2.0:1789061754.694665:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+31:14476:x1875966758611072:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 390us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061754.694672:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1789061754.703629:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061754.703776:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758611200 00000100:00100000:3.0:1789061754.703788:0:14976:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758611200 00000100:00100000:3.0:1789061754.703866:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1789061754.703878:0:14976:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c851c516-4d06-4311-8aaf-200a057f0d40+6:2353:x1875966758611200:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061754.703898:0:14976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061754.703921:0:14976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9bd96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a56a expref: -99 pid: 14976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789061754.703948:0:14976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2ea79, blocks: 0x1 00010000:00010000:3.0:1789061754.703978:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1789061754.703982:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061754.703991:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9bd96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a56a expref: 7 pid: 14976 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.704025:0:14976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9bd96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a56a expref: 7 pid: 14976 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.704039:0:14976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a41477e00, rc 0) 00000100:00100000:3.0:1789061754.704111:0:14976:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c851c516-4d06-4311-8aaf-200a057f0d40+7:2353:x1875966758611200:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 227us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061754.704119:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1789061754.709479:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061754.709583:0:16166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758611456 00000100:00100000:3.0:1789061754.709592:0:16166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758611456 00000001:00080000:2.0:1789061754.711099:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:2.0:1789061754.711125:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000001:00080000:2.0:1789061754.711131:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:2.0:1789061754.711141:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000100:00100000:2.0:1789061754.711380:0:16166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1789061754.711395:0:16166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+16:14476:x1875966758611456:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789061754.711588:0:16166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c851c516-4d06-4311-8aaf-200a057f0d40+16:14476:x1875966758611456:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 198us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061754.711597:0:16166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:1.0:1789061754.717991:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061754.718079:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758611584 00000100:00100000:3.0:1789061754.718090:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758611584 00000100:00100000:3.0:1789061754.718157:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1789061754.718168:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+16:14476:x1875966758611584:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789061754.842134:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1789061754.842158:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789061754.842324:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061754.842355:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779568000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789061754.842420:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061754.842505:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779568000 00000100:00100000:1.0:1789061754.842513:0:14975:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779568000 00000100:00100000:1.0:1789061754.842571:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789061754.842581:0:14975:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875966779568000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789061754.842743:0:14975:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789061754.842747:0:14975:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789061754.842750:0:14975:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789061754.842752:0:14975:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789061753 -> 1789061753 00002000:00010000:1.0:1789061754.842754:0:14975:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789061754.842806:0:14975:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875966779568000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 226us (385us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789061754.842813:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789061754.842833:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789061754.842934:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9719477df800/2, rc 0, transno 8589934595 00000100:00100000:1.0:1789061754.842940:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875966779568000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789061754.843443:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+14:14476:x1875966758611584:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 125275us (125459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061754.843453:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1789061754.846701:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061754.847525:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758611712 00000100:00100000:0.0:1789061754.847538:0:14976:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758611712 00000100:00100000:0.0:1789061754.847608:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789061754.847619:0:14976:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c851c516-4d06-4311-8aaf-200a057f0d40+7:2356:x1875966758611712:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789061754.847811:0:14976:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c851c516-4d06-4311-8aaf-200a057f0d40+7:2356:x1875966758611712:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 193us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061754.847818:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789061754.851157:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061754.851458:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758611968 00000100:00100000:1.0:1789061754.851469:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758611968 00000100:00100000:0.0:1789061754.851806:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:0.0:1789061754.851818:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+14:14476:x1875966758611968:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789061754.851881:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061754.851910:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944646a00/0x427fa11dc4a9bd8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a563 expref: 14 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.851931:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff971a6139cd00) 00010000:00010000:0.0:1789061754.851936:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061754.851963:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ec00/0x427fa11dc4a9bd9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.851976:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ec00/0x427fa11dc4a9bd9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.851985:0:14291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ec00/0x427fa11dc4a9bd9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061754.852174:0:14291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092df0a77 reply state 000000000c40b630 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ec00/0x427fa11dc4a9bd9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061754.852184:0:14291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789061754.852292:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c851c516-4d06-4311-8aaf-200a057f0d40+15:14476:x1875966758611968:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 477us (1147us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789061754.852299:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00010000:00010000:1.0:1789061754.855537:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ec00/0x427fa11dc4a9bd9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.855559:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ec00/0x427fa11dc4a9bd9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.855568:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ec00/0x427fa11dc4a9bd9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.855573:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63ec00 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:1.0:1789061754.855580:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ec00/0x427fa11dc4a9bd9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.855589:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ec00/0x427fa11dc4a9bd9d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.855611:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff971a6139cd00) 00010000:00010000:1.0:1789061754.855614:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061754.855619:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ec00/0x427fa11dc4a9bd9d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.855626:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63ec00/0x427fa11dc4a9bd9d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061754.856776:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061754.856824:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758612096 00000100:00100000:1.0:1789061754.856835:0:14975:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758612096 00000100:00100000:1.0:1789061754.857367:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1789061754.857378:0:14975:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c851c516-4d06-4311-8aaf-200a057f0d40+7:14476:x1875966758612096:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061754.857411:0:14975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061754.857429:0:14975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bda4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3af1657afca8a571 expref: -99 pid: 14975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.857459:0:14975:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9bd96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a56a expref: 8 pid: 14976 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.857468:0:14975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789061754.857473:0:14975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061754.857477:0:14975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bda4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a571 expref: 8 pid: 14975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.857664:0:14975:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9bd96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a56a expref: 8 pid: 14976 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.857678:0:14975:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9bd96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a56a expref: 8 pid: 14976 timeout: 629 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061754.857693:0:14975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719477ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14975:1875966779568128:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061754.857781:0:14975:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64d22d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789061754.864094:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061754.864215:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758612224 00000100:00100000:0.0:1789061754.864225:0:14278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758612224 00010000:00010000:0.0:1789061754.864268:0:14278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9bd96 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a56a expref: 9 pid: 14976 timeout: 629 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061754.864344:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1789061754.864355:0:14278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c851c516-4d06-4311-8aaf-200a057f0d40+9:2355:x1875966758612224:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061754.864369:0:14278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061754.864394:0:14278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9bd96 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a56a expref: 9 pid: 14976 timeout: 629 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.864409:0:14278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9bd96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a56a expref: 9 pid: 14976 timeout: 629 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.864436:0:14278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061754.864441:0:14278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061754.864447:0:14278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bda4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a571 expref: 9 pid: 14975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.864457:0:14278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bda4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a571 expref: 9 pid: 14975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.864534:0:14278:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bda4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a571 expref: 9 pid: 14975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061754.864548:0:14278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9719453e5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14278:1875966779568256:192.168.204.54@tcp:105: 00000100:00100000:0.0:1789061754.864624:0:14278:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a7cefff00 going to sleep for 11 seconds 00010000:00010000:3.0:1789061754.866237:0:14975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000420a348e/0x427fa11dc4a9bd96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a56a expref: 9 pid: 14976 timeout: 629 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061754.866262:0:14975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719477ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14975:1875966779568128:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061754.866296:0:14975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bda4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a571 expref: 8 pid: 14975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.866332:0:14975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff971a7c524800, rc 0) 00000100:00100000:3.0:1789061754.866398:0:14975:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c851c516-4d06-4311-8aaf-200a057f0d40+8:14476:x1875966758612096:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 9021us (9629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061754.866408:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1789061754.870540:0:14278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9719453e5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14278:1875966779568256:192.168.204.54@tcp:105: 00010000:00010000:0.0:1789061754.870581:0:14278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061754.870636:0:14278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c851c516-4d06-4311-8aaf-200a057f0d40+7:2355:x1875966758612224:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 6282us (6551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061754.870646:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1789061754.871770:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061754.871849:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758612352 00000100:00100000:3.0:1789061754.871865:0:14976:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758612352 00000100:00100000:3.0:1789061754.871904:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1789061754.871913:0:14976:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719453e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c851c516-4d06-4311-8aaf-200a057f0d40+7:2355:x1875966758612352:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789061754.872090:0:14976:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789061754.872093:0:14976:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789061753 00002000:00010000:3.0:1789061754.872096:0:14976:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789061752 00002000:00010000:3.0:1789061754.872098:0:14976:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789061753 -> 1789061753 00002000:00010000:3.0:1789061754.872100:0:14976:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789061754.872160:0:14976:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719453e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c851c516-4d06-4311-8aaf-200a057f0d40+8:2355:x1875966758612352:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 247us (395us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789061754.872167:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:1.0:1789061754.877430:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061754.877587:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758612480 00000100:00100000:3.0:1789061754.877599:0:14977:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758612480 00000100:00100000:3.0:1789061754.877663:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1789061754.877674:0:14977:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c851c516-4d06-4311-8aaf-200a057f0d40+8:2356:x1875966758612480:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789061754.877721:0:14977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.877748:0:14977:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bda4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a571 expref: 8 pid: 14975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.877772:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061754.877777:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061754.877783:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.877833:0:14977:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bda4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a571 expref: 8 pid: 14975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.877862:0:14977:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bda4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a571 expref: 8 pid: 14975 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061754.877877:0:14977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14977:1875966779568384:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789061754.877951:0:14977:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47e30300 going to sleep for 11 seconds 00000100:00100000:2.0:1789061754.887650:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061754.887753:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758612608 00000100:00100000:0.0:1789061754.887765:0:14276:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758612608 00010000:00010000:0.0:1789061754.887821:0:14276:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bda4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a571 expref: 9 pid: 14975 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061754.887878:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1789061754.887888:0:14276:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c851c516-4d06-4311-8aaf-200a057f0d40+9:2355:x1875966758612608:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061754.887904:0:14276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061754.887927:0:14276:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bda4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a571 expref: 9 pid: 14975 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.887941:0:14276:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bda4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a571 expref: 9 pid: 14975 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.887965:0:14276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789061754.887970:0:14276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789061754.887976:0:14276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.887986:0:14276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.888027:0:14276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061754.888093:0:14276:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c851c516-4d06-4311-8aaf-200a057f0d40+9:2355:x1875966758612608:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 206us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061754.888109:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00010000:00010000:3.0:1789061754.888865:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bda4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a571 expref: 8 pid: 14975 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061754.888885:0:14977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14977:1875966779568384:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789061754.888908:0:14977:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.888919:0:14977:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.888942:0:14977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.888970:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.888978:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.888987:0:14977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.888995:0:14977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476000 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061754.888999:0:14977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.889008:0:14977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.889024:0:14977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.889031:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061754.889131:0:14977:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c851c516-4d06-4311-8aaf-200a057f0d40+7:2356:x1875966758612480:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 11458us (11712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061754.889139:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1789061754.895754:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061754.895883:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758612864 00000100:00100000:1.0:1789061754.895894:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758612864 00000100:00100000:1.0:1789061754.895952:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:1.0:1789061754.895962:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+14:14476:x1875966758612864:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789061754.896061:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bdb2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.896078:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bdb2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.896090:0:14293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bdb2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.896588:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.896603:0:14293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd81 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a55c expref: 15 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.896610:0:14293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.896646:0:14293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a55c expref: 15 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.896660:0:14293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a55c expref: 15 pid: 14293 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061754.896674:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14293:1875966779568512:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789061754.896768:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64d22f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789061754.900732:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14293:1875966779568512:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789061754.900765:0:14293:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061754.901722:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061754.903002:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758612992 00000100:00100000:0.0:1789061754.903017:0:14278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758612992 00010000:00010000:0.0:1789061754.903064:0:14278:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a55c expref: 16 pid: 14293 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061754.903215:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789061754.903226:0:14278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c851c516-4d06-4311-8aaf-200a057f0d40+16:2355:x1875966758612992:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061754.903241:0:14278:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061754.903249:0:14278:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a55c expref: 16 pid: 14293 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.903263:0:14278:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a55c expref: 16 pid: 14293 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.903285:0:14278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524400/0x427fa11dc4a9bd81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a55c expref: 16 pid: 14293 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.903302:0:14278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff971a6139cd00) 00010000:00010000:0.0:1789061754.903307:0:14278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.903316:0:14278:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.903346:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.903370:0:14278:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061754.903434:0:14278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c851c516-4d06-4311-8aaf-200a057f0d40+15:2355:x1875966758612992:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 210us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061754.903441:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:1.0:1789061754.903517:0:14293:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061754.903526:0:14293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789061754.903742:0:14293:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1789061754.905089:0:14293:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1789061754.905175:0:14293:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1789061754.905266:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14293:1875966779568640:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789061754.905388:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061754.905430:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a64d22c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061754.906751:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779568640 00000100:00100000:2.0:1789061754.906765:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779568640 00000100:00100000:2.0:1789061754.906828:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789061754.906858:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14293:x1875966779568640:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789061754.906954:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14293:x1875966779568640:12345-0@lo:1000:mdt00_002.0 Request processed in 99us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061754.906961:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061754.907767:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14293:1875966779568640:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789061754.908735:0:14293:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789061754.908852:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7cb4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14293:1875966779568768:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789061754.908914:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061754.908946:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a52095840 going to sleep for 11 seconds 00000100:00100000:2.0:1789061754.909371:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779568768 00000100:00100000:2.0:1789061754.909382:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779568768 00000100:00100000:2.0:1789061754.909438:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789061754.909447:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14293:x1875966779568768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789061754.909660:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14293:x1875966779568768:12345-0@lo:1000:mdt00_002.0 Request processed in 214us (745us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789061754.909667:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061754.909988:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7cb4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14293:1875966779568768:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789061754.910026:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910037:0:14293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910044:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910050:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525400 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061754.910055:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910062:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910077:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff971a6139cd00) 00010000:00010000:3.0:1789061754.910079:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061754.910084:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910089:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525400/0x427fa11dc4a9bdb9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910184:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bd11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910201:0:14293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bd11 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910206:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bd11 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910211:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944647200 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061754.910214:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bd11 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910220:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bd11 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910227:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:3.0:1789061754.910230:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061754.910236:0:14293:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9bd18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a540 expref: 18 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910247:0:14293:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9bd18 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a540 expref: 18 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910256:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9bd18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a540 expref: 18 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.910311:0:14293:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c525200/0x427fa11dc4a9bd18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x3af1657afca8a540 expref: 18 pid: 16166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061754.910324:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14293:1875966779568896:192.168.204.54@tcp:105: 00000100:00100000:3.0:1789061754.910752:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff971a47e30600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061754.919148:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061754.919327:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14293:1875966779568896:192.168.204.54@tcp:105: 00010000:00010000:3.0:1789061754.919357:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bd11 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919369:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971944647200/0x427fa11dc4a9bd11 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919404:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476000/0x427fa11dc4a9bdc0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919419:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476000/0x427fa11dc4a9bdc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919430:0:14293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476000/0x427fa11dc4a9bdc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919442:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476000/0x427fa11dc4a9bdc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919448:0:14293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476000/0x427fa11dc4a9bdc0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919454:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476000/0x427fa11dc4a9bdc0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919460:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476000 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061754.919463:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476000/0x427fa11dc4a9bdc0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919471:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476000/0x427fa11dc4a9bdc0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919532:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:3.0:1789061754.919535:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061754.919540:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476000/0x427fa11dc4a9bdc0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919546:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a41476000/0x427fa11dc4a9bdc0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919556:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bdb2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919562:0:14293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bdb2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919568:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bdb2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919574:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524800 already unused, calling callback (ffffffffc1e864f0) 00010000:00010000:3.0:1789061754.919577:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bdb2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919582:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bdb2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919590:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff971a43636a00) 00010000:00010000:3.0:1789061754.919592:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789061754.919595:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bdb2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.919600:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a7c524800/0x427fa11dc4a9bdb2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14293 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789061754.920154:0:14325:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789061754.920160:0:14325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789061754.920209:0:14325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789061754.920216:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789061754.920393:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c851c516-4d06-4311-8aaf-200a057f0d40+18:14476:x1875966758612864:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 24428us (24645us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1789061754.920406:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000020:00080000:3.0:1789061754.920413:0:14293:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789061754.923061:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758613120 00000100:00100000:0.0:1789061754.923079:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758613120 00000100:00100000:0.0:1789061754.923159:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1789061754.923172:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a4f743c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+18:14475:x1875966758613120:12345-192.168.204.54@tcp:49:dd.0 00000100:00100000:0.0:1789061754.923322:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a4f743c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+18:14475:x1875966758613120:12345-192.168.204.54@tcp:49:dd.0 Request processed in 152us (4183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061754.923329:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1789061754.925690:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061754.925823:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758613376 00000100:00100000:0.0:1789061754.925832:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758613376 00000100:00100000:0.0:1789061754.925890:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1789061754.925899:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+18:14476:x1875966758613376:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789061754.926596:0:14294:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789061754.926720:0:14294:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789061754.926766:0:14294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9bdc7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.926795:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9bdc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.926809:0:14294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9bdc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.926825:0:14294:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9bdc7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.926831:0:14294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9bdc7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.926837:0:14294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9bdc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.926857:0:14294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789061754.926952:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c851c516-4d06-4311-8aaf-200a057f0d40+20:14476:x1875966758613376:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 1052us (1273us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789061754.926961:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000020:00080000:0.0:1789061754.926967:0:14294:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789061754.926995:0:15456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061754.927002:0:15456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9bdc7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.927010:0:15456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63e800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061754.927015:0:15456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9bdc7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.927023:0:15456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9bdc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.927037:0:15456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff971a6139cd00) 00010000:00010000:0.0:1789061754.927040:0:15456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789061754.927045:0:15456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9bdc7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.927063:0:15456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff971a4f63e800/0x427fa11dc4a9bdc7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.927077:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061754.927079:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061754.927081:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061755.139331:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779569024:0@lo:400:kworker.0 00000100:00100000:3.0:1789061755.139405:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061755.139453:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875966779569536:0@lo:400:kworker.0 00000100:00100000:3.0:1789061755.139477:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061755.139514:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061755.139521:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779569152:0@lo:400:kworker.0 00000100:00100000:3.0:1789061755.139542:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061755.139587:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779569152 00000100:00100000:3.0:1789061755.139594:0:14976:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779569152 00000100:00100000:3.0:1789061755.139638:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789061755.139646:0:14976:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779569152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061755.139692:0:14976:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875966779569152:12345-0@lo:400:kworker.0 Request processed in 47us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061755.139698:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789061755.139731:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875966779569152:0@lo:400:kworker.0 00000100:00100000:3.0:1789061755.139768:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779569024 00000100:00100000:3.0:1789061755.139771:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779569024 00000100:00100000:3.0:1789061755.139806:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789061755.139813:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75af7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:3310:x1875966779569024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061755.142356:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875966779569408:0@lo:400:kworker.0 00000100:00100000:0.0:1789061755.142427:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061755.142462:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061755.142469:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971a7d1e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779569280:0@lo:400:kworker.0 00000100:00100000:0.0:1789061755.142511:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061755.142544:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779569536 00000100:00100000:0.0:1789061755.142552:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779569536 00000100:00100000:0.0:1789061755.142597:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779569408 00000100:00100000:0.0:1789061755.142599:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779569408 00000100:00100000:0.0:1789061755.142612:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779569280 00000100:00100000:0.0:1789061755.142614:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779569280 00000100:00100000:0.0:1789061755.142628:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789061755.142635:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7d1e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875966779569536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061755.142687:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7d1e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875966779569536:12345-0@lo:400:kworker.0 Request processed in 52us (3208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061755.142694:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789061755.142709:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789061755.142715:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9719477dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875966779569408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061755.142745:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9719477dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875966779569408:12345-0@lo:400:kworker.0 Request processed in 31us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061755.142751:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789061755.142774:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789061755.142779:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971945e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779569280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061755.142821:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971945e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875966779569280:12345-0@lo:400:kworker.0 Request processed in 41us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061755.142827:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789061755.142855:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061755.142882:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875966779569280:0@lo:400:kworker.0 00000100:00100000:0.0:1789061755.142892:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875966779569408:0@lo:400:kworker.0 00000100:00100000:0.0:1789061755.142924:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875966779569536:0@lo:400:kworker.0 00000100:00100000:0.0:1789061755.143026:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779569664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061755.143055:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061755.143084:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966779569664 00000100:00100000:0.0:1789061755.143088:0:14978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966779569664 00000100:00100000:0.0:1789061755.143113:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789061755.143120:0:14978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875966779569664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061755.143147:0:14978:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789061755.143183:0:14978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875966779569664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061755.143188:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789061755.143219:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971946cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875966779569664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061755.143468:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75af7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d02fbc9-0efc-41a2-bf6f-922e38501192+19:3310:x1875966779569024:12345-0@lo:400:kworker.0 Request processed in 3654us (4061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061755.143484:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789061755.148094:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff971a7d1ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d02fbc9-0efc-41a2-bf6f-922e38501192:3310:1875966779569024:0@lo:400:kworker.0 00000100:00100000:0.0:1789061755.148249:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061755.148436:0:14980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758613504 00000100:00100000:2.0:1789061755.148444:0:14980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758613504 00000100:00100000:2.0:1789061755.148571:0:14980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1789061755.148583:0:14980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c851c516-4d06-4311-8aaf-200a057f0d40+7:2356:x1875966758613504:12345-192.168.204.54@tcp:4:dd.0 00002000:00010000:2.0:1789061755.148633:0:14980:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa2ea79, atime: 0x6aa2ea78, ctime: 0x6aa2ea79, blocks: 0x1 00010000:00010000:2.0:1789061755.148643:0:14980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010dce044/0x427fa11dc4a9bdce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061755.148660:0:14980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1789061755.148665:0:14980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061755.148672:0:14980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010dce044/0x427fa11dc4a9bdce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061755.148698:0:14980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010dce044/0x427fa11dc4a9bdce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061755.153118:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061755.153200:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061755.153306:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789061755.153374:0:14982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789061755.153394:0:14981:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789061755.153411:0:14981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758613760 00000100:00100000:1.0:1789061755.153421:0:14981:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758613760 00000100:00100000:1.0:1789061755.153472:0:14981:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789061755.153478:0:14981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758613632 00000100:00100000:1.0:1789061755.153481:0:14981:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758613632 00000100:00100000:2.0:1789061755.155071:0:16520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1789061755.155087:0:16520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c851c516-4d06-4311-8aaf-200a057f0d40+10:2356:x1875966758613760:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:2.0:1789061755.155125:0:16520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5354fba/0x427fa11dc4a9bdd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061755.155143:0:16520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061755.155147:0:16520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061755.155153:0:16520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5354fba/0x427fa11dc4a9bdd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061755.155167:0:16520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5354fba/0x427fa11dc4a9bdd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789061755.235328:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:1.0:1789061755.235346:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1789061755.235351:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:1.0:1789061755.235355:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00010000:00010000:2.0:1789061755.265426:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789061755.310346:0:14980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:0.0:1789061755.310415:0:14980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:0.0:1789061755.310446:0:14980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010dce044/0x427fa11dc4a9bdce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.310458:0:14980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010dce044/0x427fa11dc4a9bdce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.310467:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010dce044/0x427fa11dc4a9bdce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.310473:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944646000 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061755.310477:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010dce044/0x427fa11dc4a9bdce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.310513:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010dce044/0x427fa11dc4a9bdce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.310535:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010dce044/0x427fa11dc4a9bdce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.310542:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010dce044/0x427fa11dc4a9bdce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061755.310879:0:14980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c851c516-4d06-4311-8aaf-200a057f0d40+12:2356:x1875966758613504:12345-192.168.204.54@tcp:4:dd.0 Request processed in 162292us (162626us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789061755.310895:0:14980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1789061755.310933:0:14980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1789061755.310946:0:14980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c851c516-4d06-4311-8aaf-200a057f0d40+11:2354:x1875966758613632:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:0.0:1789061755.311000:0:14980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bddc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.311013:0:14980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061755.311018:0:14980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061755.311023:0:14980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.311035:0:14980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.312479:0:16520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5354fba/0x427fa11dc4a9bdd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.312527:0:16520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5354fba/0x427fa11dc4a9bdd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.312536:0:16520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5354fba/0x427fa11dc4a9bdd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.312543:0:16520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944646a00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061755.312548:0:16520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5354fba/0x427fa11dc4a9bdd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.312558:0:16520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5354fba/0x427fa11dc4a9bdd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.312576:0:16520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5354fba/0x427fa11dc4a9bdd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.312582:0:16520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5354fba/0x427fa11dc4a9bdd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061755.312662:0:16520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c851c516-4d06-4311-8aaf-200a057f0d40+10:2356:x1875966758613760:12345-192.168.204.54@tcp:4:dd.0 Request processed in 157575us (159550us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789061755.312672:0:16520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000001:00080000:1.0:1789061755.312713:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000100:00100000:0.0:1789061755.337634:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789061755.337707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789061755.337860:0:14981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758613888 00000100:00100000:1.0:1789061755.337871:0:14981:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758613888 00000100:00100000:2.0:1789061755.337911:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758614016 00000100:00100000:2.0:1789061755.337920:0:14982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758614016 00000100:00100000:1.0:1789061755.337971:0:14981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1789061755.338064:0:14981:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c851c516-4d06-4311-8aaf-200a057f0d40+10:2353:x1875966758613888:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:1.0:1789061755.338101:0:14981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e9f69c9/0x427fa11dc4a9bde3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.338120:0:14981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061755.338125:0:14981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061755.338131:0:14981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9f69c9/0x427fa11dc4a9bde3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.338145:0:14981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9f69c9/0x427fa11dc4a9bde3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061755.353047:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061755.353470:0:16520:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789061755.353483:0:16520:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1789061755.355276:0:16520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758614144 00000100:00100000:3.0:1789061755.355290:0:16520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758614144 00000100:00100000:3.0:1789061755.356170:0:16522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1789061755.356187:0:16522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c851c516-4d06-4311-8aaf-200a057f0d40+12:2354:x1875966758614016:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:3.0:1789061755.356225:0:16522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061755.356243:0:16522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061755.356247:0:16522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061755.356255:0:16522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061755.356270:0:16522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061755.357182:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061755.357275:0:16520:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789061755.357286:0:16520:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1789061755.357410:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061755.357526:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789061755.357537:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758614272 00000100:00100000:3.0:1789061755.357546:0:14982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758614272 00000100:00100000:3.0:1789061755.357589:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789061755.357596:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758614400 00000100:00100000:3.0:1789061755.357599:0:14982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758614400 00000100:00100000:1.0:1789061755.361116:0:16523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1789061755.361134:0:16523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971947e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c851c516-4d06-4311-8aaf-200a057f0d40+15:2353:x1875966758614144:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:1.0:1789061755.361181:0:16523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bdf1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.361204:0:16523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061755.361209:0:16523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061755.361218:0:16523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bdf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.361232:0:16523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bdf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789061755.438967:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1789061755.439074:0:14980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:2.0:1789061755.439079:0:14980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789061755.439104:0:14980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061755.439138:0:14980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061755.439148:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061755.439157:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fa00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:2.0:1789061755.439163:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061755.439188:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bddc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061755.439211:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bddc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061755.439219:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bddc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061755.439316:0:14980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c851c516-4d06-4311-8aaf-200a057f0d40+19:2354:x1875966758613632:12345-192.168.204.54@tcp:4:dd.0 Request processed in 128369us (286111us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789061755.439326:0:14980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1789061755.439732:0:14980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1789061755.439748:0:14980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c851c516-4d06-4311-8aaf-200a057f0d40+18:2353:x1875966758614272:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:2.0:1789061755.439801:0:14980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f324ad2/0x427fa11dc4a9bdf8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061755.439823:0:14980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061755.439828:0:14980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061755.439835:0:14980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f324ad2/0x427fa11dc4a9bdf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061755.439849:0:14980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f324ad2/0x427fa11dc4a9bdf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789061755.550029:0:16523:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1789061755.550039:0:16523:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:0.0:1789061755.550053:0:16523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bdf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.550068:0:16523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bdf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.550077:0:16523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bdf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.550096:0:16523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c524800 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061755.550102:0:16523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bdf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.550126:0:16523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bdf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.550146:0:16523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bdf1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.550154:0:16523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4cf49bd/0x427fa11dc4a9bdf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061755.550244:0:16523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c851c516-4d06-4311-8aaf-200a057f0d40+20:2353:x1875966758614144:12345-192.168.204.54@tcp:4:dd.0 Request processed in 189111us (197203us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789061755.550254:0:16523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1789061755.550289:0:16523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789061755.550299:0:16523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971946ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c851c516-4d06-4311-8aaf-200a057f0d40+19:2354:x1875966758614400:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:0.0:1789061755.550332:0:16523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bdff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.550346:0:16523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061755.550351:0:16523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061755.550358:0:16523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bdff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.550371:0:16523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bdff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.550418:0:14981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e9f69c9/0x427fa11dc4a9bde3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.550438:0:14981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e9f69c9/0x427fa11dc4a9bde3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.550446:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e9f69c9/0x427fa11dc4a9bde3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.550453:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a7c525400 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061755.550458:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e9f69c9/0x427fa11dc4a9bde3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.550467:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e9f69c9/0x427fa11dc4a9bde3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.550533:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e9f69c9/0x427fa11dc4a9bde3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.550542:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9f69c9/0x427fa11dc4a9bde3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061755.550628:0:14981:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c851c516-4d06-4311-8aaf-200a057f0d40+18:2353:x1875966758613888:12345-192.168.204.54@tcp:4:dd.0 Request processed in 212574us (213002us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789061755.550660:0:14981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000001:00080000:1.0:1789061755.550711:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1789061755.559767:0:16522:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1789061755.559826:0:16522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061755.559840:0:16522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061755.560069:0:16522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061755.560078:0:16522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a41476000 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:3.0:1789061755.560083:0:16522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061755.560094:0:16522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061755.560120:0:16522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061755.560129:0:16522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000092752ae/0x427fa11dc4a9bdea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061755.561428:0:16522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971947e48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c851c516-4d06-4311-8aaf-200a057f0d40+11:2354:x1875966758614016:12345-192.168.204.54@tcp:4:dd.0 Request processed in 205235us (223709us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789061755.561442:0:16522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000001:00080000:1.0:1789061755.634148:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1789061755.634960:0:14980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:0.0:1789061755.634980:0:14980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f324ad2/0x427fa11dc4a9bdf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.634994:0:14980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f324ad2/0x427fa11dc4a9bdf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.635003:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f324ad2/0x427fa11dc4a9bdf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.635011:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971944646200 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:0.0:1789061755.635016:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f324ad2/0x427fa11dc4a9bdf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.635026:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f324ad2/0x427fa11dc4a9bdf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.635048:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f324ad2/0x427fa11dc4a9bdf8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061755.635055:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f324ad2/0x427fa11dc4a9bdf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061755.635167:0:14980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c851c516-4d06-4311-8aaf-200a057f0d40+9:2353:x1875966758614272:12345-192.168.204.54@tcp:4:dd.0 Request processed in 195421us (277987us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789061755.635194:0:14980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00002000:00010000:1.0:1789061755.686615:0:16523:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1789061755.686637:0:16523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bdff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.686650:0:16523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bdff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.686659:0:16523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bdff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.686666:0:16523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff971a4f63fa00 already unused, calling callback (ffffffffc14298b0) 00010000:00010000:1.0:1789061755.686671:0:16523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bdff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.686680:0:16523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bdff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.686699:0:16523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bdff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061755.686708:0:16523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000098287fd/0x427fa11dc4a9bdff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061755.692289:0:16523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971946ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c851c516-4d06-4311-8aaf-200a057f0d40+7:2354:x1875966758614400:12345-192.168.204.54@tcp:4:dd.0 Request processed in 141971us (334858us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789061755.692320:0:16523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000001:00080000:1.0:1789061755.692368:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1789061756.285804:0:14279:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061757.155419:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061757.155554:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061757.155595:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061757.155616:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061757.155640:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789061757.155662:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061757.155684:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758614784 00000100:00100000:2.0:1789061757.155691:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789061757.155717:0:14975:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758614784 00000100:00100000:0.0:1789061757.155928:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758615040 00000100:00100000:0.0:1789061757.155934:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758615040 00000100:00100000:3.0:1789061757.155993:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758615296 00000100:00100000:0.0:1789061757.155996:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758614656 00000100:00100000:3.0:1789061757.155999:0:14975:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758615296 00000100:00100000:0.0:1789061757.156002:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758614656 00000100:00100000:3.0:1789061757.156026:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758614912 00000100:00100000:3.0:1789061757.156031:0:14975:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758614912 00000100:00100000:0.0:1789061757.156044:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:3.0:1789061757.156056:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758615168 00000100:00100000:0.0:1789061757.156059:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84c9e5f0-47c8-4184-809e-4af95217330e+6:2354:x1875966758615040:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061757.156069:0:14975:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758615168 00000100:00100000:3.0:1789061757.156092:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1789061757.156103:0:14975:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c851c516-4d06-4311-8aaf-200a057f0d40+5:2354:x1875966758614784:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061757.156187:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84c9e5f0-47c8-4184-809e-4af95217330e+6:2354:x1875966758615040:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 134us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061757.156196:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1789061757.156217:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1789061757.156224:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+20:2354:x1875966758614656:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789061757.156243:0:14975:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c851c516-4d06-4311-8aaf-200a057f0d40+5:2354:x1875966758614784:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 136us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061757.156252:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789061757.156258:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c851c516-4d06-4311-8aaf-200a057f0d40+20:2354:x1875966758614656:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 34us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061757.156266:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1789061757.156295:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1789061757.156302:0:16426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84c9e5f0-47c8-4184-809e-4af95217330e+5:2354:x1875966758615296:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061757.156328:0:16426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84c9e5f0-47c8-4184-809e-4af95217330e+5:2354:x1875966758615296:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061757.156335:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1789061757.156348:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:0.0:1789061757.156355:0:16426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c851c516-4d06-4311-8aaf-200a057f0d40+5:2354:x1875966758614912:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061757.156379:0:16426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c851c516-4d06-4311-8aaf-200a057f0d40+5:2354:x1875966758614912:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061757.156386:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1789061757.156398:0:14975:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a7cd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84c9e5f0-47c8-4184-809e-4af95217330e+5:2354:x1875966758615168:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789061757.156400:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1789061757.156435:0:14975:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a7cd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84c9e5f0-47c8-4184-809e-4af95217330e+5:2354:x1875966758615168:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 40us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061757.156455:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00080000:2.0:1789061757.156577:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061757.156584:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789061757.156587:0:14287:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061757.156705:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875966758614528 00000100:00100000:1.0:1789061757.156712:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875966758614528 00000100:00100000:1.0:1789061757.156937:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:1.0:1789061757.156948:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff971a75af6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+13:2354:x1875966758614528:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789061757.156997:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff971a75af6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282d5b89-cba7-4159-9b75-d113061ec0de+13:2354:x1875966758614528:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 53us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061757.157003:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00010000:00010000:0.0:1789061757.309720:0:15456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789061757.383881:0:16560:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1789061758.334158:0:14280:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29668 lines, 29668 kept, 0 dropped, 0 bad.